Nov 05 03:34:18 devstack cinder-volume[76052]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 03:34:18 devstack cinder-volume[76052]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:34:18 devstack cinder-volume[76052]: we strongly recommend against using it for new projects.
Nov 05 03:34:18 devstack cinder-volume[76052]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:34:18 devstack cinder-volume[76052]: framework.  For more detail see
Nov 05 03:34:18 devstack cinder-volume[76052]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:34:18 devstack cinder-volume[76052]:   import eventlet  # noqa
Nov 05 03:34:21 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:34:21 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:34:21 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:34:21 devstack cinder-volume[76052]: INFO dbcounter [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Registered counter for database cinder
Nov 05 03:34:21 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:34:22 devstack cinder-volume[76052]: DEBUG dbcounter [-] [76052] Writer thread running {{(pid=76052) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:34:22 devstack cinder-volume[76052]: INFO cinder.rpc [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 03:34:22 devstack cinder-volume[76052]: INFO cinder.rpc [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 03:34:22 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:34:22 devstack cinder-volume[76052]: INFO cinder.volume.manager [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Determined volume DB was empty at startup.
Nov 05 03:34:22 devstack cinder-volume[76052]: DEBUG cinder.volume.manager [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76052) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Nov 05 03:34:22 devstack cinder-volume[76052]: INFO cinder.volume.manager [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 03:34:22 devstack cinder-volume[76052]: WARNING stevedore.named [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:34:22 devstack cinder-volume[76052]: WARNING castellan.key_manager [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:34:22 devstack cinder-volume[76052]: WARNING cinder.keymgr.conf_key_mgr [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:34:22 devstack cinder-volume[76052]: DEBUG cinder.volume.drivers.lvm [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76052) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 03:34:22 devstack cinder-volume[76052]: DEBUG oslo_concurrency.processutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76052) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:22 devstack cinder-volume[76052]: DEBUG oslo_concurrency.processutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=76052) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:34:23 devstack cinder-volume[76052]: INFO cinder.rpc [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 03:34:23 devstack cinder-volume[76052]: INFO cinder.rpc [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version.
Nov 05 03:34:23 devstack cinder-volume[76052]: WARNING stevedore.named [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:34:23 devstack cinder-volume[76052]: WARNING castellan.key_manager [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:34:23 devstack cinder-volume[76052]: INFO cinder.volume.manager [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_db.sqlalchemy.engines [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:34:23 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Starting 1 workers
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Started child 76200 {{(pid=76052) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Full set of CONF: {{(pid=76052) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] ******************************************************************************** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Configuration options gathered from: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] ================================================================================ {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] allow_availability_zone_fallback = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] allow_compression_on_image_upload = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] allowed_direct_url_schemes     = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] api_rate_limit                 = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] auth_strategy                  = keystone {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] az_cache_duration              = 3600 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_availability_zone      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76200]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_host                   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_name                   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_stats_polling_interval = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backup_api_class               = cinder.backup.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backup_name_template           = backup-%s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backup_use_same_host           = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backup_use_temp_snapshot       = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] changed_blocks_max_limit       = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] changed_blocks_rpc_timeout     = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] chap_password                  = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] chap_username                  =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_internal_tenant_project_id = eca2a5acc5ff42a998dd48c1b63d3c48 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_internal_tenant_user_id = 05220f578477440e832e3164f5085cfa {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cloned_volume_same_az          = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cluster                        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] compression_format             = gzip {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] config_dir                     = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] config_source                  = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] control_exchange               = openstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] debug                          = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] default_availability_zone      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] default_group_type             = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] default_volume_type            = lvmdriver-1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] disk_geometry                  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] driver_client_cert             = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] driver_client_cert_key         = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] driver_data_namespace          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] driver_ssl_cert_path           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] driver_ssl_cert_verify         = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] driver_use_ssl                 = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] enable_force_upload            = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] enable_new_services            = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] enable_unsupported_driver      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] enforce_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] filter_function                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_api_insecure            = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_api_servers             = ['http://192.168.122.130/image'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_api_ssl_compression     = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_ca_certificates_file    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_certfile                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_keyfile                 = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_num_retries             = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance_request_timeout         = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] goodness_function              = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] graceful_shutdown_timeout      = 5 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] group_api_class                = cinder.group.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] host                           = devstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_compress_on_upload       = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_conversion_address_space_limit = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_conversion_cpu_limit     = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_conversion_disable       = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_upload_use_cinder_backend = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_upload_use_internal_tenant = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_volume_cache_enabled     = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_volume_cache_max_count   = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] image_volume_cache_max_size_gb = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] init_host_max_objects_retrieval = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] iscsi_target_flags             =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] iscsi_write_cache              = on {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] iser_helper                    = tgtadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] iser_ip_address                = 192.168.122.130 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] iser_port                      = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_color                      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_config_append              = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76200]: INFO cinder.volume.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_dir                        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_file                       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_options                    = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_rotate_interval            = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_rotate_interval_type       = days {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] log_rotation_type              = none {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] max_age                        = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] max_logfile_count              = 30 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] max_logfile_size_mb            = 200 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] max_over_subscription_ratio    = 20.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] message_reap_interval          = 86400 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] message_ttl                    = 2592000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] migration_create_volume_timeout_secs = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] monkey_patch                   = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] monkey_patch_modules           = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] my_ip                          = 192.168.122.130 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] no_snapshot_gb_quota           = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] num_iser_scan_tries            = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] num_shell_tries                = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] num_volume_device_scan_tries   = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] nvmeof_conn_info_version       = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] nvmet_ns_id                    = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] nvmet_port_id                  = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_max_limit                = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_volume_ext_list          = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_volume_listen_port       = 8776 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_volume_use_ssl           = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] osapi_volume_workers           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] per_volume_size_limit          = -1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] periodic_fuzzy_delay           = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] periodic_interval              = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] public_endpoint                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] publish_errors                 = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_backup_gigabytes         = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_backups                  = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_gigabytes                = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_groups                   = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_snapshots                = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] quota_volumes                  = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] rate_limit_burst               = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] rate_limit_except_level        = CRITICAL {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] rate_limit_interval            = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] reinit_driver_count            = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] replication_device             = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] report_discard_supported       = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] report_interval                = 120 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] reservation_clean_interval     = 86400 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] reservation_expire             = 86400 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] reserved_image_namespaces      = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] reserved_percentage            = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] rpc_response_timeout           = 120 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] run_external_periodic_tasks    = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] scst_target_driver             = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] scst_target_iqn_name           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_down_time              = 720 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] shell_completion               = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] snapshot_name_template         = snapshot-%s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] snapshot_same_host             = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] split_loggers                  = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] state_path                     = /opt/stack/data/cinder {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] storage_availability_zone      = nova {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] storage_protocol               = iSCSI {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] syslog_log_facility            = LOG_USER {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] target_helper                  = lioadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] target_ip_address              = 192.168.122.130 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] target_port                    = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] target_protocol                = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] target_secondary_ip_addresses  = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] trace_flags                    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] transport_url                  = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] until_refresh                  = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_chap_auth                  = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_default_quota_class        = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_journal                    = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_json                       = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_multipath_for_image_xfer   = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_stderr                     = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] use_syslog                     = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] verify_glance_signatures       = enabled {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_api_class               = cinder.volume.api.API {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_backend_name            = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_clear                   = zero {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_clear_ionice            = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_clear_size              = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_copy_bps_limit          = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_dd_blocksize            = 1M {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_name_template           = volume-%s {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_service_inithost_offload = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volume_usage_audit_period      = month {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] zoning_mode                    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_concurrency.disable_process_locking = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.auth_section = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.auth_type   = password {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.auth_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.cache       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.certfile    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.include_service_catalog = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.insecure    = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.interface   = public {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.keyfile     = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcache_username = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.region_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.service_type = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.backend                  = dogpile.cache.null {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.backend_argument         = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.backend_expiration_time  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.config_prefix            = cache.oslo {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.debug_cache_backend      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.enable_retry_client      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.enable_socket_keepalive  = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.enabled                  = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.expiration_time          = 600 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.hashclient_retry_attempts = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_dead_retry      = 300 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_sasl_enabled    = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.password                 = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack sudo[76205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.proxies                  = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.redis_db                 = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.redis_server             = localhost:6379 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack sudo[76205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.retry_attempts           = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.retry_delay              = 0.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.socket_keepalive_count   = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.socket_keepalive_idle    = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.socket_keepalive_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.socket_timeout           = 1.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.tls_allowed_ciphers      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.tls_cafile               = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.tls_certfile             = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.tls_enabled              = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.tls_keyfile              = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cache.username                 = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] coordination.backend_url       = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.asyncio_connection    = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.asyncio_slave_connection = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.backend               = sqlalchemy {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.connection            = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.connection_debug      = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.connection_parameters =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.connection_recycle_time = 3600 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.connection_trace      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.db_inc_retry_interval = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.db_max_retries        = 20 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.db_max_retry_interval = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.db_retry_interval     = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.max_overflow          = 50 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.max_pool_size         = 5 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.max_retries           = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.mysql_wsrep_sync_wait = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.pool_timeout          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.retry_interval        = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.slave_connection      = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.sqlite_synchronous    = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.synchronous_reader    = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] database.use_db_reconnect      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_tracing.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.connection_string     = messaging:// {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.enabled               = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.es_doc_type           = notification {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.es_scroll_size        = 10000 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.es_scroll_time        = 2m {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.filter_error_trace    = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.hmac_keys             = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.sentinel_service_name = mymaster {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.socket_timeout        = 0.1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.trace_requests        = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler.trace_sqlalchemy      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler_jaeger.process_tags   = {} {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler_jaeger.service_name_prefix = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] profiler_otlp.service_name_prefix = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.enforce_new_defaults = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.policy_default_rule = default {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.group          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.helper_command = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] privsep_osbrick.user           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.group         = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.helper_command = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] cinder_sys_admin.user          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.auth_section      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.auth_type         = password {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.cafile            = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.certfile          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.collect_timing    = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.insecure          = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.keyfile           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.send_service_user_token = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.split_loggers     = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.timeout           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.tls_ciphers       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] service_user.tls_min_version   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.auth_section            = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.auth_type               = password {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.certfile                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.collect_timing          = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.insecure                = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.keyfile                 = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.region_name             = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.split_loggers           = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.timeout                 = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.tls_ciphers             = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] glance.tls_min_version         = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.backend_availability_zone = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.chap_password = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.chap_username =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.disk_geometry = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.driver_client_cert = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.driver_client_cert_key = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.driver_data_namespace = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.driver_use_ssl = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.extra_capabilities = {} {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.filter_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.goodness_function = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.iscsi_target_flags =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.iscsi_write_cache = on {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.iser_port     = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.lvm_share_target = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.lvm_type      = auto {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.num_shell_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.replication_device = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.report_discard_supported = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.reserved_percentage = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.target_helper = tgtadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.target_port   = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.target_protocol = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.trace_flags   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.unique_fqdn_network = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.use_chap_auth = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_backend_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_clear  = zero {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_clear_ionice = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_clear_size = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_reports.file_event_handler = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_reports.log_dir           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.backend_host       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.chap_password      = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.chap_username      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.disk_geometry      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.driver_client_cert = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.extra_capabilities = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.filter_function    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.goodness_function  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.iser_helper        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.iser_port          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.lvm_type           = auto {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.replication_device = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.report_discard_supported = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.reserved_percentage = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.scst_target_driver = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.storage_protocol   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.target_ip_address  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.target_port        = 3260 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.trace_flags        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_clear       = zero {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] lvmdriver-1.volumes_dir        = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_notifications.driver = [] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_notifications.retry = -1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] key_manager.fixed_key          = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.barbican_api_version  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.barbican_endpoint     = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.barbican_endpoint_type = public {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.barbican_region_name  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.cafile                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.certfile              = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.collect_timing        = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.insecure              = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.keyfile               = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.number_of_retries     = 60 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.retry_delay           = 1 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.send_service_user_token = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.split_loggers         = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.timeout               = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.tls_ciphers           = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.tls_min_version       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.verify_ssl            = True {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican.verify_ssl_path       = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.auth_section = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.auth_type = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.cafile   = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.certfile = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.collect_timing = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.insecure = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.keyfile  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.split_loggers = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.timeout  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.tls_ciphers = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] barbican_service_user.tls_min_version = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.approle_role_id          = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.approle_secret_id        = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.auth_method              = approle {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.auth_path                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.kv_mountpoint            = secret {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.kv_path                  = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.kv_version               = 2 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.namespace                = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.root_token_id            = **** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.ssl_ca_crt_file          = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.timeout                  = 60.0 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.token_file               = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.token_role               = None {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.use_ssl                  = False {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:34:23 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] ******************************************************************************** {{(pid=76052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 03:34:23 devstack sudo[76205]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:23 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:23 devstack sudo[76272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:23 devstack sudo[76272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:24 devstack sudo[76272]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.284s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:34:24 devstack cinder-volume[76200]: INFO cinder.brick.local_dev.lvm [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:24 devstack sudo[76406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:34:24 devstack sudo[76406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:24 devstack sudo[76406]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG cinder.brick.local_dev.lvm [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76200) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:24 devstack sudo[76494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:24 devstack sudo[76494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:24 devstack sudo[76494]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:24 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:24 devstack sudo[76694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:24 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:25 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:25 devstack sudo[76814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 03:34:25 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:25 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.264s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:25 devstack sudo[76817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:34:25 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:25 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:25 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:25 devstack sudo[76903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:34:25 devstack sudo[76903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:26 devstack sudo[76903]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:26 devstack sudo[76906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:26 devstack sudo[76906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:26 devstack sudo[76906]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:26 devstack sudo[76948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:26 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:26 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:26 devstack sudo[77005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:26 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:26 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:26 devstack cinder-volume[76200]: INFO cinder.volume.drivers.lvm [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:26 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:26 devstack sudo[77009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:26 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:27 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG cinder.volume.drivers.lvm [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Updating volume stats {{(pid=76200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:27 devstack sudo[77012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:34:27 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:27 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:27 devstack sudo[77015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:27 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:27 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:27 devstack sudo[77018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:27 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:27 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:27 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:27 devstack sudo[77021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:27 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:28 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:28 devstack cinder-volume[76200]: INFO cinder.volume.driver [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG cinder.volume.driver [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76200) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_db.sqlalchemy.engines [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76200) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writer thread running {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG cinder.db.api [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Building query based on filter {{(pid=76200) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG cinder.image.image_utils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76200) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Nov 05 03:34:28 devstack cinder-volume[76200]: INFO cinder.keymgr.migration [None req-c175e07d-81e2-4d62-b900-4fe075e62a12 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG cinder.volume.drivers.lvm [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Updating volume stats {{(pid=76200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:28 devstack sudo[77024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:34:28 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:28 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:28 devstack sudo[77028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:28 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:28 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:28 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:28 devstack sudo[77033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:28 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:29 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:29 devstack sudo[77036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:29 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:29 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG cinder.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Notifying Schedulers of capabilities ... {{(pid=76200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:34:29 devstack cinder-volume[76200]: INFO cinder.volume.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Driver initialization completed successfully.
Nov 05 03:34:29 devstack cinder-volume[76200]: INFO cinder.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Initiating service 2 cleanup
Nov 05 03:34:29 devstack cinder-volume[76200]: INFO cinder.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Service 2 cleanup completed.
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG cinder.service [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Creating RPC server for service cinder-volume {{(pid=76200) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG cinder.service [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76200) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 03:34:29 devstack cinder-volume[76200]: INFO cinder.volume.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG cinder.volume.drivers.lvm [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Updating volume stats {{(pid=76200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:29 devstack sudo[77044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:34:29 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:29 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:29 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:30 devstack sudo[77047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:30 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:30 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:30 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:30 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:30 devstack sudo[77050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:34:30 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:30 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:30 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:30 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:34:30 devstack sudo[77053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:34:30 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:34:30 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root
Nov 05 03:34:30 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:34:30 devstack cinder-volume[76200]: INFO cinder.volume.manager [None req-ec6ab9f8-8b86-438a-8af8-aaeb702c523a None None] Driver post RPC initialization completed successfully.
Nov 05 03:34:33 devstack cinder-volume[76052]: DEBUG dbcounter [-] [76052] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76052) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:34:40 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writing DB stats cinder:SELECT=3 {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:34:40 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:35:16 devstack cinder-volume[76200]: DEBUG oslo_service.periodic_task [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running periodic task VolumeManager._thread_info {{(pid=76200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:35:16 devstack cinder-volume[76200]: DEBUG cinder.volume.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] thread count: 6 {{(pid=76200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:35:16 devstack cinder-volume[76200]: DEBUG cinder.volume.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] thread info: [<_MainThread(MainThread, started 139472607170688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139472508668416)>, <Thread(Thread-3 (stat_writer), started daemon 139472494335104)>, <Thread(Rabbit-heartbeat, started daemon 139472494495424)>, <Thread(Thread-5 (_runner), started daemon 139472492103552)>, <Thread(Thread-7 (_runner), started daemon 139472490203648)>] {{(pid=76200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:36:16 devstack cinder-volume[76200]: DEBUG oslo_service.periodic_task [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:36:16 devstack cinder-volume[76200]: DEBUG cinder.volume.drivers.lvm [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Updating volume stats {{(pid=76200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:36:16 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:36:16 devstack sudo[82173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:36:16 devstack sudo[82173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:36:17 devstack sudo[82173]: pam_unix(sudo:session): session closed for user root
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:36:17 devstack sudo[82176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:36:17 devstack sudo[82176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:36:17 devstack sudo[82176]: pam_unix(sudo:session): session closed for user root
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:36:17 devstack sudo[82179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:36:17 devstack sudo[82179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:36:17 devstack sudo[82179]: pam_unix(sudo:session): session closed for user root
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:36:17 devstack sudo[82182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:36:17 devstack sudo[82182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:36:17 devstack sudo[82182]: pam_unix(sudo:session): session closed for user root
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG cinder.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Notifying Schedulers of capabilities ... {{(pid=76200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG oslo_service.periodic_task [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running periodic task VolumeManager._thread_info {{(pid=76200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG cinder.volume.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] thread count: 6 {{(pid=76200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:36:17 devstack cinder-volume[76200]: DEBUG cinder.volume.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] thread info: [<_MainThread(MainThread, started 139472607170688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139472508668416)>, <Thread(Thread-3 (stat_writer), started daemon 139472494335104)>, <Thread(Rabbit-heartbeat, started daemon 139472494495424)>, <Thread(Thread-5 (_runner), started daemon 139472492103552)>, <Thread(Thread-7 (_runner), started daemon 139472490203648)>] {{(pid=76200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:36:40 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writing DB stats cinder:SELECT=1 {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:36:40 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writing DB stats cinder:UPDATE=1 {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:37:16 devstack cinder-volume[76200]: DEBUG oslo_service.periodic_task [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:37:16 devstack cinder-volume[76200]: DEBUG cinder.volume.drivers.lvm [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Updating volume stats {{(pid=76200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:37:16 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:16 devstack sudo[84087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:37:16 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:17 devstack sudo[84106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:37:17 devstack sudo[84106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[84106]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:17 devstack sudo[84111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:37:17 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:37:17 devstack sudo[84114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:37:17 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:37:17 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG cinder.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Notifying Schedulers of capabilities ... {{(pid=76200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG oslo_service.periodic_task [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running periodic task VolumeManager._thread_info {{(pid=76200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG cinder.volume.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] thread count: 6 {{(pid=76200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:37:17 devstack cinder-volume[76200]: DEBUG cinder.volume.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] thread info: [<_MainThread(MainThread, started 139472607170688)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139472508668416)>, <Thread(Thread-3 (stat_writer), started daemon 139472494335104)>, <Thread(Rabbit-heartbeat, started daemon 139472494495424)>, <Thread(Thread-5 (_runner), started daemon 139472492103552)>, <Thread(Thread-7 (_runner), started daemon 139472490203648)>] {{(pid=76200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:38:16 devstack cinder-volume[76200]: DEBUG oslo_service.periodic_task [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:38:16 devstack cinder-volume[76200]: DEBUG cinder.volume.drivers.lvm [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Updating volume stats {{(pid=76200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 03:38:16 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:16 devstack sudo[85486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 03:38:16 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:17 devstack sudo[85498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:38:17 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:17 devstack sudo[85501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 03:38:17 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:17 devstack sudo[85507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 03:38:17 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:17 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG oslo_concurrency.processutils [None req-961c88f0-0022-491b-8642-b77ef600363a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:17 devstack cinder-volume[76200]: DEBUG cinder.manager [None req-961c88f0-0022-491b-8642-b77ef600363a None None] Notifying Schedulers of capabilities ... {{(pid=76200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:38:40 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writing DB stats cinder:SELECT=1 {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:38:40 devstack cinder-volume[76200]: DEBUG dbcounter [-] [76200] Writing DB stats cinder:UPDATE=1 {{(pid=76200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:38:52 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Caught SIGTERM, stopping children
Nov 05 03:38:52 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Acquiring lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:38:52 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Acquired lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:38:52 devstack cinder-volume[76052]: DEBUG oslo_concurrency.lockutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Releasing lock "singleton_lock" {{(pid=76052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:38:52 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Stop services. {{(pid=76052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 03:38:52 devstack cinder-volume[76052]: DEBUG oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Killing children. {{(pid=76052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 03:38:52 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Waiting on 1 children to exit
Nov 05 03:38:54 devstack cinder-volume[76200]: DEBUG oslo_concurrency.lockutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Acquiring lock "singleton_lock" {{(pid=76200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:38:54 devstack cinder-volume[76200]: DEBUG oslo_concurrency.lockutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Acquired lock "singleton_lock" {{(pid=76200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:38:54 devstack cinder-volume[76200]: DEBUG oslo_concurrency.lockutils [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Releasing lock "singleton_lock" {{(pid=76200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:38:54 devstack cinder-volume[76200]: WARNING amqp [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:38:54 devstack cinder-volume[76200]: WARNING amqp [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:38:54 devstack cinder-volume[76052]: INFO oslo_service.backend._eventlet.service [None req-96c60f34-f03b-4f17-8c89-546ba053eb64 None None] Child 76200 exited with status 0
Nov 05 03:38:55 devstack cinder-volume[86261]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 03:38:55 devstack cinder-volume[86261]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:38:55 devstack cinder-volume[86261]: we strongly recommend against using it for new projects.
Nov 05 03:38:55 devstack cinder-volume[86261]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:38:55 devstack cinder-volume[86261]: framework.  For more detail see
Nov 05 03:38:55 devstack cinder-volume[86261]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:38:55 devstack cinder-volume[86261]:   import eventlet  # noqa
Nov 05 03:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:38:57 devstack cinder-volume[86261]: INFO dbcounter [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Registered counter for database cinder
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writer thread running {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:38:58 devstack cinder-volume[86261]: INFO cinder.rpc [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 03:38:58 devstack cinder-volume[86261]: INFO cinder.rpc [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:38:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Determined volume DB was empty at startup.
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86261) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Nov 05 03:38:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 03:38:58 devstack cinder-volume[86261]: WARNING stevedore.named [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:38:58 devstack cinder-volume[86261]: WARNING castellan.key_manager [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:38:58 devstack cinder-volume[86261]: WARNING cinder.keymgr.conf_key_mgr [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:38:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:38:58 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Starting 1 workers
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Started child 86478 {{(pid=86261) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Full set of CONF: {{(pid=86261) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] ******************************************************************************** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Configuration options gathered from: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] ================================================================================ {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] allow_availability_zone_fallback = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] allow_compression_on_image_upload = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] allowed_direct_url_schemes     = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] api_rate_limit                 = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] auth_strategy                  = keystone {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_availability_zone      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_host                   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_name                   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_stats_polling_interval = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backup_api_class               = cinder.backup.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backup_name_template           = backup-%s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backup_use_same_host           = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backup_use_temp_snapshot       = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] changed_blocks_max_limit       = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] changed_blocks_rpc_timeout     = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] chap_password                  = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] chap_username                  =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_internal_tenant_project_id = eca2a5acc5ff42a998dd48c1b63d3c48 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_internal_tenant_user_id = 05220f578477440e832e3164f5085cfa {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cluster                        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] compression_format             = gzip {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] config_dir                     = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] config_source                  = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] control_exchange               = openstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] debug                          = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] default_availability_zone      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] default_group_type             = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] default_volume_type            = QuobyteHD {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86478]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] disk_geometry                  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] driver_client_cert             = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] driver_client_cert_key         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] driver_data_namespace          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] driver_ssl_cert_path           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] driver_ssl_cert_verify         = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] driver_use_ssl                 = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] enable_new_services            = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] enable_unsupported_driver      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] enforce_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] filter_function                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_api_insecure            = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_api_servers             = ['http://192.168.122.130/image'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_api_ssl_compression     = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_ca_certificates_file    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_certfile                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_keyfile                 = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_num_retries             = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance_request_timeout         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] goodness_function              = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] graceful_shutdown_timeout      = 5 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] group_api_class                = cinder.group.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] host                           = devstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_compress_on_upload       = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_conversion_address_space_limit = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_conversion_cpu_limit     = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_conversion_disable       = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_upload_use_cinder_backend = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_upload_use_internal_tenant = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_volume_cache_enabled     = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_volume_cache_max_count   = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] image_volume_cache_max_size_gb = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] init_host_max_objects_retrieval = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] iscsi_target_flags             =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] iscsi_write_cache              = on {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] iser_helper                    = tgtadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] iser_ip_address                = 192.168.122.130 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] iser_port                      = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_color                      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_config_append              = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_dir                        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_file                       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_options                    = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_rotate_interval            = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_rotate_interval_type       = days {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] log_rotation_type              = none {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] max_age                        = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] max_logfile_count              = 30 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] max_logfile_size_mb            = 200 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] max_over_subscription_ratio    = 20.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] message_reap_interval          = 86400 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] message_ttl                    = 2592000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] migration_create_volume_timeout_secs = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] monkey_patch                   = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] monkey_patch_modules           = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] my_ip                          = 192.168.122.130 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] no_snapshot_gb_quota           = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] num_iser_scan_tries            = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] num_shell_tries                = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] num_volume_device_scan_tries   = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] nvmeof_conn_info_version       = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] nvmet_ns_id                    = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] nvmet_port_id                  = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_max_limit                = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_volume_ext_list          = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_volume_listen_port       = 8776 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_volume_use_ssl           = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] osapi_volume_workers           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] per_volume_size_limit          = -1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] periodic_fuzzy_delay           = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] periodic_interval              = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] public_endpoint                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] publish_errors                 = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_backup_gigabytes         = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_backups                  = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_gigabytes                = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_groups                   = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_snapshots                = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Starting volume driver QuobyteDriver (1.2)
Nov 05 03:38:58 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.remotefs [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86478) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] quota_volumes                  = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] rate_limit_burst               = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] rate_limit_except_level        = CRITICAL {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] rate_limit_interval            = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] reinit_driver_count            = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] replication_device             = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] report_discard_supported       = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] report_interval                = 120 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] reservation_clean_interval     = 86400 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] reservation_expire             = 86400 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] reserved_image_namespaces      = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] reserved_percentage            = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] rpc_response_timeout           = 120 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] run_external_periodic_tasks    = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] scst_target_driver             = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] scst_target_iqn_name           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_down_time              = 720 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] shell_completion               = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] snapshot_name_template         = snapshot-%s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] split_loggers                  = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] state_path                     = /opt/stack/data/cinder {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] storage_availability_zone      = nova {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] storage_protocol               = iSCSI {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] syslog_log_facility            = LOG_USER {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] target_helper                  = lioadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] target_ip_address              = 192.168.122.130 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] target_port                    = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] target_protocol                = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] target_secondary_ip_addresses  = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] trace_flags                    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] transport_url                  = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] until_refresh                  = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_chap_auth                  = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_default_quota_class        = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_journal                    = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_json                       = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_multipath_for_image_xfer   = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_stderr                     = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] use_syslog                     = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] verify_glance_signatures       = enabled {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_api_class               = cinder.volume.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_backend_name            = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_clear                   = zero {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_clear_ionice            = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_clear_size              = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_copy_bps_limit          = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_dd_blocksize            = 1M {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_name_template           = volume-%s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_service_inithost_offload = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volume_usage_audit_period      = month {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] zoning_mode                    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_concurrency.disable_process_locking = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.auth_section = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.auth_type   = password {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.auth_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.cache       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.certfile    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.include_service_catalog = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.insecure    = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.interface   = public {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.keyfile     = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcache_username = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.region_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.service_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.backend                  = dogpile.cache.null {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.backend_argument         = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.backend_expiration_time  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.config_prefix            = cache.oslo {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.debug_cache_backend      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.enable_retry_client      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.enable_socket_keepalive  = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.enabled                  = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.expiration_time          = 600 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.hashclient_retry_attempts = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_dead_retry      = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_sasl_enabled    = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.password                 = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.proxies                  = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.redis_db                 = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.redis_server             = localhost:6379 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.retry_attempts           = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.retry_delay              = 0.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.socket_keepalive_count   = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.socket_keepalive_idle    = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.socket_keepalive_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.socket_timeout           = 1.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.tls_allowed_ciphers      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.tls_cafile               = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.tls_certfile             = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.tls_enabled              = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.tls_keyfile              = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cache.username                 = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] coordination.backend_url       = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.asyncio_connection    = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.asyncio_slave_connection = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.backend               = sqlalchemy {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.connection            = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.connection_debug      = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.connection_parameters =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.connection_recycle_time = 3600 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.connection_trace      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.db_inc_retry_interval = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.db_max_retries        = 20 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.db_max_retry_interval = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.db_retry_interval     = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.max_overflow          = 50 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.max_pool_size         = 5 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.max_retries           = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.mysql_wsrep_sync_wait = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.pool_timeout          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.retry_interval        = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.slave_connection      = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.sqlite_synchronous    = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.synchronous_reader    = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] database.use_db_reconnect      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_tracing.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.connection_string     = messaging:// {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.enabled               = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.es_doc_type           = notification {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.es_scroll_size        = 10000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.es_scroll_time        = 2m {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.filter_error_trace    = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.hmac_keys             = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.sentinel_service_name = mymaster {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.socket_timeout        = 0.1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.trace_requests        = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler.trace_sqlalchemy      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler_jaeger.process_tags   = {} {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler_jaeger.service_name_prefix = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] profiler_otlp.service_name_prefix = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.enforce_new_defaults = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.policy_default_rule = default {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.group          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.helper_command = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] privsep_osbrick.user           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.group         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.helper_command = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] cinder_sys_admin.user          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.auth_section      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.auth_type         = password {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.cafile            = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.certfile          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.collect_timing    = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.insecure          = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.keyfile           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.send_service_user_token = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.split_loggers     = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.timeout           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.tls_ciphers       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] service_user.tls_min_version   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.auth_section            = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.auth_type               = password {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.certfile                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.collect_timing          = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.insecure                = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.keyfile                 = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.region_name             = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.split_loggers           = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.timeout                 = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.tls_ciphers             = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] glance.tls_min_version         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.backend_availability_zone = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.chap_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.chap_username =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.disk_geometry = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.driver_client_cert = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.driver_client_cert_key = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.driver_data_namespace = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.driver_use_ssl = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.extra_capabilities = {} {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.filter_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.goodness_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.iscsi_target_flags =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.iscsi_write_cache = on {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.iser_port     = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86478) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Nov 05 03:38:58 devstack cinder-volume[86478]: WARNING cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 03:38:58 devstack cinder-volume[86478]: WARNING cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_host      =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_login     = admin {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Running cmd (subprocess): mount.quobyte {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_mount_options = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_password  = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_private_key =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_share_path =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.num_shell_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.quobyte_volume_url = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.replication_device = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.report_discard_supported = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.reserved_percentage = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.target_helper = tgtadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.target_port   = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.target_protocol = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.trace_flags   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.unique_fqdn_network = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.use_chap_auth = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_backend_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_clear  = zero {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_clear_ionice = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_clear_size = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_reports.file_event_handler = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_reports.log_dir           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.backend_availability_zone = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.backend_host         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.chap_password        = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.chap_username        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.disk_geometry        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.driver_client_cert   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.driver_data_namespace = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.extra_capabilities   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.filter_function      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.goodness_function    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.iser_helper          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.iser_ip_address      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.iser_port            = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_host             = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_login            = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_mount_options    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_password         = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_private_key      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_share_path       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.num_shell_tries      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.replication_device   = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.report_discard_supported = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.reserved_percentage  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.scst_target_driver   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.storage_protocol     = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.target_helper        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.target_ip_address    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.target_port          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.target_prefix        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.target_protocol      = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.trace_flags          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.use_chap_auth        = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_clear         = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_clear_size    = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] QuobyteHD.volumes_dir          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_notifications.driver = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_notifications.retry = -1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] key_manager.fixed_key          = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.barbican_api_version  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.barbican_endpoint     = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.barbican_endpoint_type = public {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.barbican_region_name  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.cafile                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.certfile              = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.collect_timing        = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.insecure              = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.keyfile               = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.number_of_retries     = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.retry_delay           = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.send_service_user_token = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.split_loggers         = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.timeout               = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.tls_ciphers           = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.tls_min_version       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.verify_ssl            = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican.verify_ssl_path       = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.auth_section = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.auth_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.cafile   = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.collect_timing = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.keyfile  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.split_loggers = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.timeout  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.tls_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] barbican_service_user.tls_min_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.approle_role_id          = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.approle_secret_id        = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.auth_method              = approle {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.auth_path                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.kv_mountpoint            = secret {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.kv_path                  = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.kv_version               = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.namespace                = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.root_token_id            = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.ssl_ca_crt_file          = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.timeout                  = 60.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.token_file               = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.token_role               = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.use_ssl                  = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:38:58 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] ******************************************************************************** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 03:38:58 devstack quobyte-client[86483]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 03:38:58 devstack quobyte-client[86483]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 03:38:58 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=86478) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:38:59 devstack cinder-volume[86478]: INFO cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 ...
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd -c /etc/quobyte/client-cinder.cfg {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:59 devstack sudo[86484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd -c /etc/quobyte/client-cinder.cfg
Nov 05 03:38:59 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:59 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.433s {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:59 devstack cinder-volume[86478]: INFO cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 succeeded
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=86478) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.444s {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:59 devstack sudo[86586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:38:59 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:38:59 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.278s {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:38:59 devstack cinder-volume[86478]: INFO cinder.volume.driver [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.volume.driver [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5548400878906, 'free_capacity_gb': 1773.5548400878906, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86478) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_db.sqlalchemy.engines [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86478) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG dbcounter [-] [86478] Writer thread running {{(pid=86478) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.db.api [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Building query based on filter {{(pid=86478) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.image.image_utils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86478) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Nov 05 03:38:59 devstack cinder-volume[86478]: INFO cinder.keymgr.migration [None req-60104162-6104-4aad-8ce3-2e9e30ca7c46 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=86478) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=86478) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:38:59 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:38:59 devstack sudo[86589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:38:59 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:00 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.238s {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG cinder.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Notifying Schedulers of capabilities ... {{(pid=86478) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:39:00 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Driver initialization completed successfully.
Nov 05 03:39:00 devstack cinder-volume[86478]: INFO cinder.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Initiating service 3 cleanup
Nov 05 03:39:00 devstack cinder-volume[86478]: INFO cinder.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Service 3 cleanup completed.
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG cinder.service [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Creating RPC server for service cinder-volume {{(pid=86478) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG cinder.service [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86478) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 03:39:00 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=86478) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG cinder.volume.drivers.quobyte [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=86478) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86478) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:00 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:39:00 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:00 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:00 devstack cinder-volume[86478]: DEBUG oslo_concurrency.processutils [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.263s {{(pid=86478) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:00 devstack cinder-volume[86478]: INFO cinder.volume.manager [None req-33dee9dc-fcd1-4f9b-a93a-322f0daeb863 None None] Driver post RPC initialization completed successfully.
Nov 05 03:39:05 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Caught SIGTERM, stopping children
Nov 05 03:39:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Acquiring lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:39:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Acquired lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:39:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Releasing lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:39:05 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Stop services. {{(pid=86261) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 03:39:05 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Killing children. {{(pid=86261) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 03:39:05 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Waiting on 1 children to exit
Nov 05 03:39:08 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Acquiring lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:39:08 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Acquired lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:39:08 devstack cinder-volume[86478]: DEBUG oslo_concurrency.lockutils [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Releasing lock "singleton_lock" {{(pid=86478) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:39:08 devstack cinder-volume[86478]: WARNING amqp [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:39:08 devstack cinder-volume[86478]: WARNING amqp [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 03:39:08 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-bb1d5b93-7b98-4567-a903-f5acfe835c13 None None] Child 86478 exited with status 0
Nov 05 03:39:09 devstack cinder-volume[86800]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 03:39:09 devstack cinder-volume[86800]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:39:09 devstack cinder-volume[86800]: we strongly recommend against using it for new projects.
Nov 05 03:39:09 devstack cinder-volume[86800]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:39:09 devstack cinder-volume[86800]: framework.  For more detail see
Nov 05 03:39:09 devstack cinder-volume[86800]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:39:09 devstack cinder-volume[86800]:   import eventlet  # noqa
Nov 05 03:39:11 devstack cinder-volume[86800]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 03:39:11 devstack cinder-volume[86800]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 03:39:11 devstack cinder-volume[86800]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86800) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 03:39:12 devstack cinder-volume[86800]: INFO dbcounter [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Registered counter for database cinder
Nov 05 03:39:12 devstack cinder-volume[86800]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG dbcounter [-] [86800] Writer thread running {{(pid=86800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:39:13 devstack cinder-volume[86800]: INFO cinder.rpc [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 03:39:13 devstack cinder-volume[86800]: INFO cinder.rpc [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:39:13 devstack cinder-volume[86800]: INFO cinder.volume.manager [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Determined volume DB was empty at startup.
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG cinder.volume.manager [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86800) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Nov 05 03:39:13 devstack cinder-volume[86800]: WARNING stevedore.named [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 03:39:13 devstack cinder-volume[86800]: WARNING castellan.key_manager [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:39:13 devstack cinder-volume[86800]: WARNING cinder.keymgr.conf_key_mgr [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 03:39:13 devstack cinder-volume[86800]: INFO cinder.volume.manager [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_db.sqlalchemy.engines [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:39:13 devstack cinder-volume[86800]: INFO oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Starting 1 workers
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Started child 87098 {{(pid=86800) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Full set of CONF: {{(pid=86800) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] ******************************************************************************** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] Configuration options gathered from: {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] ================================================================================ {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] allow_availability_zone_fallback = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] allow_compression_on_image_upload = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] allowed_direct_url_schemes     = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] api_rate_limit                 = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] auth_strategy                  = keystone {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_availability_zone      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_host                   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_name                   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_stats_polling_interval = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backup_api_class               = cinder.backup.api.API {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backup_name_template           = backup-%s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backup_use_same_host           = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backup_use_temp_snapshot       = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] changed_blocks_max_limit       = 1000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[87098]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] changed_blocks_rpc_timeout     = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] chap_password                  = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] chap_username                  =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_internal_tenant_project_id = eca2a5acc5ff42a998dd48c1b63d3c48 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_internal_tenant_user_id = 05220f578477440e832e3164f5085cfa {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cluster                        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] compression_format             = gzip {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] config_dir                     = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] config_source                  = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] control_exchange               = openstack {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] debug                          = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] default_availability_zone      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] default_group_type             = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] default_volume_type            = QuobyteHD {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] disk_geometry                  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] driver_client_cert             = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] driver_client_cert_key         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] driver_data_namespace          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] driver_ssl_cert_path           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] driver_ssl_cert_verify         = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] driver_use_ssl                 = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] enable_new_services            = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] enable_unsupported_driver      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] enforce_multipath_for_image_xfer = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] filter_function                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_api_insecure            = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_api_servers             = ['http://192.168.122.130/image'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_api_ssl_compression     = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_ca_certificates_file    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_certfile                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_keyfile                 = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_num_retries             = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance_request_timeout         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] goodness_function              = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] graceful_shutdown_timeout      = 5 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] group_api_class                = cinder.group.api.API {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] host                           = devstack {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_compress_on_upload       = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_conversion_address_space_limit = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_conversion_cpu_limit     = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_conversion_disable       = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_upload_use_cinder_backend = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_upload_use_internal_tenant = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_volume_cache_enabled     = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_volume_cache_max_count   = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] image_volume_cache_max_size_gb = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] init_host_max_objects_retrieval = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] iscsi_target_flags             =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] iscsi_write_cache              = on {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] iser_helper                    = tgtadm {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] iser_ip_address                = 192.168.122.130 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] iser_port                      = 3260 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_color                      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_config_append              = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_dir                        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_file                       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_options                    = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_rotate_interval            = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_rotate_interval_type       = days {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] log_rotation_type              = none {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] max_age                        = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] max_logfile_count              = 30 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] max_logfile_size_mb            = 200 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] max_over_subscription_ratio    = 20.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] message_reap_interval          = 86400 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] message_ttl                    = 2592000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] migration_create_volume_timeout_secs = 300 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] monkey_patch                   = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] monkey_patch_modules           = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] my_ip                          = 192.168.122.130 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] no_snapshot_gb_quota           = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] num_iser_scan_tries            = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] num_shell_tries                = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] num_volume_device_scan_tries   = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] nvmeof_conn_info_version       = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] nvmet_ns_id                    = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] nvmet_port_id                  = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_max_limit                = 1000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Starting volume driver QuobyteDriver (1.2)
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_volume_ext_list          = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87098) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_volume_listen_port       = 8776 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_volume_use_ssl           = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] osapi_volume_workers           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] per_volume_size_limit          = -1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] periodic_fuzzy_delay           = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] periodic_interval              = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] public_endpoint                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] publish_errors                 = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_backup_gigabytes         = 1000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_backups                  = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_gigabytes                = 1000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_groups                   = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_snapshots                = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] quota_volumes                  = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] rate_limit_burst               = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] rate_limit_except_level        = CRITICAL {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] rate_limit_interval            = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] reinit_driver_count            = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] replication_device             = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] report_discard_supported       = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] report_interval                = 120 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] reservation_clean_interval     = 86400 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] reservation_expire             = 86400 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] reserved_image_namespaces      = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] reserved_percentage            = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] rpc_response_timeout           = 120 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] run_external_periodic_tasks    = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] scst_target_driver             = iscsi {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] scst_target_iqn_name           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_down_time              = 720 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] shell_completion               = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] snapshot_name_template         = snapshot-%s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] split_loggers                  = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] state_path                     = /opt/stack/data/cinder {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] storage_availability_zone      = nova {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] storage_protocol               = iSCSI {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] syslog_log_facility            = LOG_USER {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] target_helper                  = lioadm {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] target_ip_address              = 192.168.122.130 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] target_port                    = 3260 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] target_protocol                = iscsi {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] target_secondary_ip_addresses  = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] trace_flags                    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] transport_url                  = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] until_refresh                  = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_chap_auth                  = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_default_quota_class        = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_journal                    = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_json                       = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_multipath_for_image_xfer   = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_stderr                     = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] use_syslog                     = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] verify_glance_signatures       = enabled {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_api_class               = cinder.volume.api.API {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_backend_name            = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_clear                   = zero {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_clear_ionice            = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_clear_size              = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_copy_bps_limit          = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_dd_blocksize            = 1M {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_name_template           = volume-%s {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_service_inithost_offload = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volume_usage_audit_period      = month {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] zoning_mode                    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_concurrency.disable_process_locking = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.auth_section = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.auth_type   = password {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.auth_version = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.cache       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.certfile    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.include_service_catalog = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.insecure    = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.interface   = public {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.keyfile     = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_password = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcache_username = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.region_name = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.service_type = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.130/identity {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.backend                  = dogpile.cache.null {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.backend_argument         = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.backend_expiration_time  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.config_prefix            = cache.oslo {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.debug_cache_backend      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.enable_retry_client      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.enable_socket_keepalive  = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.enabled                  = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.expiration_time          = 600 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.hashclient_retry_attempts = 2 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_dead_retry      = 300 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_sasl_enabled    = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.password                 = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.proxies                  = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.redis_db                 = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.redis_server             = localhost:6379 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.retry_attempts           = 2 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.retry_delay              = 0.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.socket_keepalive_count   = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.socket_keepalive_idle    = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.socket_keepalive_interval = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.socket_timeout           = 1.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.tls_allowed_ciphers      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.tls_cafile               = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.tls_certfile             = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.tls_enabled              = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.tls_keyfile              = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cache.username                 = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] coordination.backend_url       = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.asyncio_connection    = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.asyncio_slave_connection = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.backend               = sqlalchemy {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.connection            = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.connection_debug      = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.connection_parameters =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.connection_recycle_time = 3600 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.connection_trace      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.db_inc_retry_interval = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87098) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.db_max_retries        = 20 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.db_max_retry_interval = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.db_retry_interval     = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.max_overflow          = 50 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.max_pool_size         = 5 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.max_retries           = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.mysql_wsrep_sync_wait = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Running cmd (subprocess): mount.quobyte {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.pool_timeout          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.retry_interval        = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.slave_connection      = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.sqlite_synchronous    = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.synchronous_reader    = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] database.use_db_reconnect      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_tracing.insecure = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.connection_string     = messaging:// {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.enabled               = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.es_doc_type           = notification {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.es_scroll_size        = 10000 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.es_scroll_time        = 2m {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.filter_error_trace    = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.hmac_keys             = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.sentinel_service_name = mymaster {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.socket_timeout        = 0.1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.trace_requests        = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler.trace_sqlalchemy      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler_jaeger.process_tags   = {} {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler_jaeger.service_name_prefix = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] profiler_otlp.service_name_prefix = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.enforce_new_defaults = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.policy_default_rule = default {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.group          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.helper_command = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] privsep_osbrick.user           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.group         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.helper_command = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] cinder_sys_admin.user          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.auth_section      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.auth_type         = password {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.cafile            = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.certfile          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.collect_timing    = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.insecure          = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.keyfile           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.send_service_user_token = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.split_loggers     = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.timeout           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.tls_ciphers       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] service_user.tls_min_version   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.auth_section            = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.auth_type               = password {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.certfile                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.collect_timing          = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.insecure                = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.keyfile                 = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.region_name             = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.split_loggers           = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.timeout                 = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.tls_ciphers             = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] glance.tls_min_version         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.backend_availability_zone = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.chap_password = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.chap_username =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.disk_geometry = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.driver_client_cert = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack quobyte-client[87099]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 03:39:13 devstack quobyte-client[87099]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.driver_client_cert_key = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.driver_data_namespace = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.driver_use_ssl = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.extra_capabilities = {} {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.filter_function = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.goodness_function = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.iscsi_target_flags =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.iscsi_write_cache = on {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.iser_ip_address = 192.168.122.130 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.iser_port     = 3260 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_host      =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_login     = admin {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_mount_options = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_password  = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_private_key =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_share_path =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.num_shell_tries = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.quobyte_volume_url = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.replication_device = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.report_discard_supported = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.reserved_percentage = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.target_helper = tgtadm {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.target_ip_address = 192.168.122.130 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.target_port   = 3260 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.target_protocol = iscsi {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.trace_flags   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.unique_fqdn_network = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.use_chap_auth = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_backend_name = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_clear  = zero {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_clear_ionice = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_clear_size = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_reports.file_event_handler = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_reports.log_dir           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.backend_availability_zone = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.backend_host         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.chap_password        = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.chap_username        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.disk_geometry        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.driver_client_cert   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.driver_data_namespace = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.extra_capabilities   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.filter_function      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.goodness_function    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.iser_helper          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.iser_ip_address      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.iser_port            = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_host             = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_login            = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_mount_options    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_password         = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_private_key      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_share_path       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.num_shell_tries      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.replication_device   = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.report_discard_supported = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.reserved_percentage  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.scst_target_driver   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.storage_protocol     = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.target_helper        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.target_ip_address    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.target_port          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.target_prefix        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.target_protocol      = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.trace_flags          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.use_chap_auth        = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_clear         = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_clear_size    = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] QuobyteHD.volumes_dir          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_notifications.driver = [] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_notifications.retry = -1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] key_manager.fixed_key          = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.barbican_api_version  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.barbican_endpoint     = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.barbican_endpoint_type = public {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.barbican_region_name  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.cafile                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.certfile              = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.collect_timing        = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.insecure              = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.keyfile               = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.number_of_retries     = 60 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.retry_delay           = 1 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.send_service_user_token = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.split_loggers         = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.timeout               = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.tls_ciphers           = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.tls_min_version       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.verify_ssl            = True {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican.verify_ssl_path       = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.auth_section = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.auth_type = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.cafile   = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.certfile = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.collect_timing = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.insecure = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.keyfile  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.split_loggers = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.timeout  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.tls_ciphers = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] barbican_service_user.tls_min_version = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.approle_role_id          = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.approle_secret_id        = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.auth_method              = approle {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.auth_path                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.kv_mountpoint            = secret {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.kv_path                  = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.kv_version               = 2 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.namespace                = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.root_token_id            = **** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.ssl_ca_crt_file          = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.timeout                  = 60.0 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.token_file               = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.token_role               = None {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.use_ssl                  = False {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 03:39:13 devstack cinder-volume[86800]: DEBUG oslo_service.backend._eventlet.service [None req-3fa2b65b-6a44-4b34-8733-c8984c34e663 None None] ******************************************************************************** {{(pid=86800) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 03:39:13 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:13 devstack cinder-volume[87098]: INFO cinder.volume.driver [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG cinder.volume.driver [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5548400878906, 'free_capacity_gb': 1773.5548400878906, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG oslo_db.sqlalchemy.engines [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writer thread running {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 03:39:13 devstack cinder-volume[87098]: DEBUG cinder.db.api [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Building query based on filter {{(pid=87098) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87098) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:14 devstack cinder-volume[87098]: INFO cinder.keymgr.migration [None req-bd02568c-bdb5-421f-87d5-60af8282471f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 03:39:14 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:39:14 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:14 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.253s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:39:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Driver initialization completed successfully.
Nov 05 03:39:14 devstack cinder-volume[87098]: INFO cinder.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Initiating service 3 cleanup
Nov 05 03:39:14 devstack cinder-volume[87098]: INFO cinder.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Service 3 cleanup completed.
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.service [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Creating RPC server for service cinder-volume {{(pid=87098) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.service [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87098) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 03:39:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:39:14 devstack sudo[87123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:39:14 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:39:14 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root
Nov 05 03:39:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.250s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:39:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d2813fdb-95bf-40b9-8d35-26dedb2b3969 None None] Driver post RPC initialization completed successfully.
Nov 05 03:39:23 devstack cinder-volume[86800]: DEBUG dbcounter [-] [86800] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86800) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:39:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:39:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:40:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:40:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 6 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:40:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Flow 'volume_create_manager' (ca9e08f2-d8e1-425b-928e-e8ef998c6fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717dc11a-33cf-420a-919e-54b0301d8043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717dc11a-33cf-420a-919e-54b0301d8043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1787215243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fb43d3-c362-4a28-aadc-edab833a7719,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4eeeba36a558405db4ace60a8a5e8a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:13Z,use_quota=True,user_id='1f6f0cede57f41b99df631061c58dec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2d3085-7470-4a6d-a12b-1a0a0500d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2d3085-7470-4a6d-a12b-1a0a0500d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd70def-2205-4131-8d95-4d9d5657600f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd70def-2205-4131-8d95-4d9d5657600f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fb43d3-c362-4a28-aadc-edab833a7719', 'volume_name': 'volume-52fb43d3-c362-4a28-aadc-edab833a7719', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addfe31a-fcab-440b-99c7-01a454749136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addfe31a-fcab-440b-99c7-01a454749136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad07d63b-1897-4c97-9433-bcd1d36ba424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:13 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Volume 52fb43d3-c362-4a28-aadc-edab833a7719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fb43d3-c362-4a28-aadc-edab833a7719', 'volume_size': 1}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1787215243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fb43d3-c362-4a28-aadc-edab833a7719,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4eeeba36a558405db4ace60a8a5e8a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:13Z,use_quota=True,user_id='1f6f0cede57f41b99df631061c58dec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Creating volume 52fb43d3-c362-4a28-aadc-edab833a7719 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:40:13 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:40:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:13 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719 1073741824
Nov 05 03:40:13 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:14 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719 1073741824" returned: 0 in 1.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:14 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719
Nov 05 03:40:14 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:15 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad07d63b-1897-4c97-9433-bcd1d36ba424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fb43d3-c362-4a28-aadc-edab833a7719', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0233cb85-5944-44c5-affe-bf19f5cbd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Volume volume-52fb43d3-c362-4a28-aadc-edab833a7719 (52fb43d3-c362-4a28-aadc-edab833a7719): created successfully
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0233cb85-5944-44c5-affe-bf19f5cbd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Flow 'volume_create_manager' (ca9e08f2-d8e1-425b-928e-e8ef998c6fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-7396f88b-707d-4579-8a9b-a88c7f40a1f5 req-6f37fcec-375e-4539-97aa-6358f1a71792 tempest-VolumesGetTestJSON-706561508 None] Created volume successfully.
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Flow 'volume_create_manager' (52074b03-8098-41ad-ab0c-1a650b8a974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8b91f-189b-44a6-a310-568829b590fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Acquiring lock "cinder-52fb43d3-c362-4a28-aadc-edab833a7719-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8b91f-189b-44a6-a310-568829b590fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-366610165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b90157-6ed5-4a29-a777-99ae54228031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47c7e2d55dc47d49a101d70ad33af77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:17Z,use_quota=True,user_id='99739ff5354149ceb4c1fedeb2a53e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5645629a-8cf6-44ad-9e0c-2e13a353efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5645629a-8cf6-44ad-9e0c-2e13a353efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d34045-767e-47c8-95b8-2d4e3c0ec7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d34045-767e-47c8-95b8-2d4e3c0ec7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b90157-6ed5-4a29-a777-99ae54228031', 'volume_name': 'volume-e4b90157-6ed5-4a29-a777-99ae54228031', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e30ae7-802c-4a2e-b153-b890b9fa3eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e30ae7-802c-4a2e-b153-b890b9fa3eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6547f03-0810-43e0-ae1d-cf659cebad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Volume e4b90157-6ed5-4a29-a777-99ae54228031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b90157-6ed5-4a29-a777-99ae54228031', 'volume_size': 1}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-366610165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b90157-6ed5-4a29-a777-99ae54228031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47c7e2d55dc47d49a101d70ad33af77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:17Z,use_quota=True,user_id='99739ff5354149ceb4c1fedeb2a53e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Creating volume e4b90157-6ed5-4a29-a777-99ae54228031 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:40:17 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Lock "cinder-52fb43d3-c362-4a28-aadc-edab833a7719-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:17 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031 1073741824
Nov 05 03:40:17 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Acquiring lock "cinder-quobyte-52fb43d3-c362-4a28-aadc-edab833a7719" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Lock "cinder-quobyte-52fb43d3-c362-4a28-aadc-edab833a7719" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:17 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj9_shlqw/privsep.sock']
Nov 05 03:40:17 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj9_shlqw/privsep.sock
Nov 05 03:40:17 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:18 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031 1073741824" returned: 0 in 1.005s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:18 devstack sudo[87987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031
Nov 05 03:40:18 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:19 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6547f03-0810-43e0-ae1d-cf659cebad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b90157-6ed5-4a29-a777-99ae54228031', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257113dd-0550-466e-bb08-942917dd40ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Volume volume-e4b90157-6ed5-4a29-a777-99ae54228031 (e4b90157-6ed5-4a29-a777-99ae54228031): created successfully
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257113dd-0550-466e-bb08-942917dd40ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Flow 'volume_create_manager' (52074b03-8098-41ad-ab0c-1a650b8a974a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-989e655c-68b0-4258-aa74-73585cbba625 tempest-DeleteServersTestJSON-1473756110 None] Created volume successfully.
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 03:40:19 devstack cinder-volume[87098]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 03:40:19 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Spawned new privsep daemon via rootwrap
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Accepted privsep connection to /tmp/tmpj9_shlqw/privsep.sock {{(pid=87098) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 03:40:19 devstack cinder-volume[87098]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87997
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d0013e-2906-4154-b31e-46a4cd03fd78]: (2,) {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d28bc-23aa-44cf-94c6-83216933299c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:20 devstack sudo[88012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719
Nov 05 03:40:20 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:20 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719" returned: 0 in 0.807s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:20 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719
Nov 05 03:40:20 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:21 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-52fb43d3-c362-4a28-aadc-edab833a7719" returned: 0 in 0.605s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Lock "cinder-quobyte-52fb43d3-c362-4a28-aadc-edab833a7719" released by "delete_volume" :: held 3.692s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:21 devstack cinder-volume[87098]: WARNING cinder.quota [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:40:21 devstack cinder-volume[87098]: WARNING cinder.quota [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG cinder.quota [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Created reservations ['e1b07de0-024e-4d49-b01c-35d66b47696c', '21babf03-755c-4c25-b5c9-54e1b2f91a67', '503b4d2f-3ba2-433c-a97a-5729594dcb74', '3c949d01-1a64-4477-8be3-dd420e731697'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:21 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:40:21 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:22 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.659s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:22 devstack cinder-volume[87098]: DEBUG cinder.manager [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Deleted volume successfully.
Nov 05 03:40:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-9b8421a3-8135-4c65-8180-95f0eac7a1db req-6936372c-9c4c-4dc9-89b6-cf6abb61c744 tempest-VolumesGetTestJSON-706561508 None] Lock "cinder-52fb43d3-c362-4a28-aadc-edab833a7719-delete_volume" released by "delete_volume" :: held 5.077s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:24 devstack cinder-volume[87098]: WARNING py.warnings [req-d3b6f414-511e-4f3e-97dd-d7d2dca2bcd5 req-c10da03b-0cfd-4adc-bed4-e69d312b6463 tempest-DeleteServersTestJSON-1473756110 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 05 03:40:24 devstack cinder-volume[87098]:   .first()
Nov 05 03:40:24 devstack cinder-volume[87098]: 
Nov 05 03:40:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d3b6f414-511e-4f3e-97dd-d7d2dca2bcd5 req-c10da03b-0cfd-4adc-bed4-e69d312b6463 tempest-DeleteServersTestJSON-1473756110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d3b6f414-511e-4f3e-97dd-d7d2dca2bcd5 req-c10da03b-0cfd-4adc-bed4-e69d312b6463 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d3b6f414-511e-4f3e-97dd-d7d2dca2bcd5 req-c10da03b-0cfd-4adc-bed4-e69d312b6463 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d3b6f414-511e-4f3e-97dd-d7d2dca2bcd5 req-c10da03b-0cfd-4adc-bed4-e69d312b6463 tempest-DeleteServersTestJSON-1473756110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-e4b90157-6ed5-4a29-a777-99ae54228031', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '284a58eb-aa8e-49dc-8ea9-73479e8dc350', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:40:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-d3b6f414-511e-4f3e-97dd-d7d2dca2bcd5 req-c10da03b-0cfd-4adc-bed4-e69d312b6463 tempest-DeleteServersTestJSON-1473756110 None] attachment_update completed successfully.
Nov 05 03:40:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-4aef51c1-317e-40eb-b59f-38c58a3ab11a req-9eda771c-2c66-4b2d-a971-095e62763456 tempest-DeleteServersTestJSON-1473756110 None] Terminate volume connection completed successfully.
Nov 05 03:40:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-4aef51c1-317e-40eb-b59f-38c58a3ab11a req-9eda771c-2c66-4b2d-a971-095e62763456 tempest-DeleteServersTestJSON-1473756110 None] Deleting attachment 284a58eb-aa8e-49dc-8ea9-73479e8dc350. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Acquiring lock "cinder-e4b90157-6ed5-4a29-a777-99ae54228031-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Lock "cinder-e4b90157-6ed5-4a29-a777-99ae54228031-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Acquiring lock "cinder-quobyte-e4b90157-6ed5-4a29-a777-99ae54228031" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Lock "cinder-quobyte-e4b90157-6ed5-4a29-a777-99ae54228031" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530eea5-0120-4c96-b504-b0da8d5b16e6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:32 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031
Nov 05 03:40:32 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:32 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031" returned: 0 in 0.667s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:33 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031
Nov 05 03:40:33 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fbfc57a2-47db-4f89-b1c3-308d585d0950 tempest-GroupSnapshotsV319Test-1287296010 None] Group tempest-GroupSnapshotsV319Test-Group-4447793: creating
Nov 05 03:40:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fbfc57a2-47db-4f89-b1c3-308d585d0950 tempest-GroupSnapshotsV319Test-1287296010 None] Group tempest-GroupSnapshotsV319Test-Group-4447793: created successfully
Nov 05 03:40:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fbfc57a2-47db-4f89-b1c3-308d585d0950 tempest-GroupSnapshotsV319Test-1287296010 None] Create group completed successfully.
Nov 05 03:40:33 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e4b90157-6ed5-4a29-a777-99ae54228031" returned: 0 in 0.582s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Lock "cinder-quobyte-e4b90157-6ed5-4a29-a777-99ae54228031" released by "delete_volume" :: held 1.320s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Flow 'volume_create_manager' (ca49f1e9-e1a4-4d61-ac85-b2bb5bfe5d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6beb7c8-7c10-4079-9278-0af395dc3d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Created reservations ['237cb141-9688-461a-88d5-e1a27d63226d', '3cd9e143-ae18-4323-acf3-2c01531a726b', '25319d1e-5350-4cf4-a51b-94c17498def9', 'd254a21b-daea-41ef-b120-774685ffbc7e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6beb7c8-7c10-4079-9278-0af395dc3d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1149716808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7883d4-69e5-4c4e-9767-ed442f4db747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5f05185f9c438b97c32919b709330f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:34Z,use_quota=True,user_id='c9c0b0678d114b73b1d2bed09dafcbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b77bfe-1cca-42b6-a451-adb58c171287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b77bfe-1cca-42b6-a451-adb58c171287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1947eb8-cc26-4d5a-a814-9261b929c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1947eb8-cc26-4d5a-a814-9261b929c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7883d4-69e5-4c4e-9767-ed442f4db747', 'volume_name': 'volume-4d7883d4-69e5-4c4e-9767-ed442f4db747', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cb8566-56d8-4d62-b665-15b02c66be63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6cb8566-56d8-4d62-b665-15b02c66be63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a093296-b496-43b6-b143-906f0fda7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Volume 4d7883d4-69e5-4c4e-9767-ed442f4db747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7883d4-69e5-4c4e-9767-ed442f4db747', 'volume_size': 1}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1149716808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7883d4-69e5-4c4e-9767-ed442f4db747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5f05185f9c438b97c32919b709330f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:34Z,use_quota=True,user_id='c9c0b0678d114b73b1d2bed09dafcbf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Creating volume 4d7883d4-69e5-4c4e-9767-ed442f4db747 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:40:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:33 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 1073741824
Nov 05 03:40:33 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:34 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:40:34 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:34 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Deleted volume successfully.
Nov 05 03:40:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c99204f6-f821-4414-ab5a-9797ae17f360 tempest-DeleteServersTestJSON-1473756110 None] Lock "cinder-e4b90157-6ed5-4a29-a777-99ae54228031-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:34 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 1073741824" returned: 0 in 0.812s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:34 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747
Nov 05 03:40:34 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Flow 'volume_create_manager' (76f82ceb-a975-4779-897b-33e2ba142641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704f2455-c097-414b-9e8f-236ccb54dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704f2455-c097-414b-9e8f-236ccb54dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886835513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a241c412-efe4-4e0e-aa46-7aa80e5c562a,host='devstack@QuobyteHD#QuobyteHD',id=b7e4b236-3749-4746-9bfc-ec987ceab446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43e79897144e9f859835d028dd1ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:35Z,use_quota=True,user_id='555f77de3be748f1b9c00566164cf621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e0ef866-c061-494e-a7df-a6dd6647a31f),volume_type_id=5e0ef866-c061-494e-a7df-a6dd6647a31f)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26ac7a5-3534-4f65-bfb3-40957ba185b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26ac7a5-3534-4f65-bfb3-40957ba185b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae8895-9d49-41ed-94b3-cf323556c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:35 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae8895-9d49-41ed-94b3-cf323556c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e4b236-3749-4746-9bfc-ec987ceab446', 'volume_name': 'volume-b7e4b236-3749-4746-9bfc-ec987ceab446', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61afa4fc-8f1c-4d4c-8ba4-b14a7138e0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61afa4fc-8f1c-4d4c-8ba4-b14a7138e0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc23853-9ad7-4c35-a681-7067dd21af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Volume b7e4b236-3749-4746-9bfc-ec987ceab446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e4b236-3749-4746-9bfc-ec987ceab446', 'volume_size': 1}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747" returned: 0 in 0.616s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a241c412-efe4-4e0e-aa46-7aa80e5c562a,created_at=2026-11-05T02:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886835513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a241c412-efe4-4e0e-aa46-7aa80e5c562a,host='devstack@QuobyteHD#QuobyteHD',id=b7e4b236-3749-4746-9bfc-ec987ceab446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f43e79897144e9f859835d028dd1ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:40:35Z,use_quota=True,user_id='555f77de3be748f1b9c00566164cf621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e0ef866-c061-494e-a7df-a6dd6647a31f),volume_type_id=5e0ef866-c061-494e-a7df-a6dd6647a31f)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Creating volume b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:40:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a093296-b496-43b6-b143-906f0fda7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7883d4-69e5-4c4e-9767-ed442f4db747', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:35 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 1073741824
Nov 05 03:40:35 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e68dae3-3211-493f-876a-4c921c1f068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Volume volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 (4d7883d4-69e5-4c4e-9767-ed442f4db747): created successfully
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e68dae3-3211-493f-876a-4c921c1f068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Flow 'volume_create_manager' (ca49f1e9-e1a4-4d61-ac85-b2bb5bfe5d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7691674e-f97c-4387-8b05-f28714bd948a tempest-VolumesAdminNegativeTest-1644578661 None] Created volume successfully.
Nov 05 03:40:36 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 1073741824" returned: 0 in 0.693s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:36 devstack sudo[88733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446
Nov 05 03:40:36 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:36 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446" returned: 0 in 0.527s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc23853-9ad7-4c35-a681-7067dd21af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e4b236-3749-4746-9bfc-ec987ceab446', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb65c285-c651-491c-a889-7ca15df0ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:40:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Volume volume-b7e4b236-3749-4746-9bfc-ec987ceab446 (b7e4b236-3749-4746-9bfc-ec987ceab446): created successfully
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb65c285-c651-491c-a889-7ca15df0ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:40:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Flow 'volume_create_manager' (76f82ceb-a975-4779-897b-33e2ba142641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:40:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a34ea2c2-afff-4088-9767-0526d8c31aa4 tempest-GroupSnapshotsV319Test-1287296010 None] Created volume successfully.
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Acquiring lock "cinder-4d7883d4-69e5-4c4e-9767-ed442f4db747-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Lock "cinder-4d7883d4-69e5-4c4e-9767-ed442f4db747-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Acquiring lock "cinder-quobyte-4d7883d4-69e5-4c4e-9767-ed442f4db747" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Lock "cinder-quobyte-4d7883d4-69e5-4c4e-9767-ed442f4db747" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9d0ba-000e-4e90-923e-a045a56c4c58]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:37 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747
Nov 05 03:40:37 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:37 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:38 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747
Nov 05 03:40:38 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:38 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d7883d4-69e5-4c4e-9767-ed442f4db747" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Lock "cinder-quobyte-4d7883d4-69e5-4c4e-9767-ed442f4db747" released by "delete_volume" :: held 0.971s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Created reservations ['a932befb-b5f4-48c0-8e5b-2e0db7bde236', '67c79e7f-6e3c-453e-bda7-9a86ec4d722d', '81be9fee-c47c-46c8-afba-a462cabcf97e', '37ae95cf-89c3-4173-83db-11ed74a75eb0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:38 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:40:38 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] GroupSnapshot 3247fa9e-7f7d-41d0-8dad-7c0014633a29: creating.
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Group snapshot 3247fa9e-7f7d-41d0-8dad-7c0014633a29: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Creating offline snapshot b18e001b-8739-4f3e-a081-fb678d285ce9 of volume b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[960315d2-82bc-46b6-93f5-30deffd8144b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:39 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:39 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Deleted volume successfully.
Nov 05 03:40:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5495879a-8e6c-4303-ae67-41f4a661daea tempest-VolumesAdminNegativeTest-1644578661 None] Lock "cinder-4d7883d4-69e5-4c4e-9767-ed442f4db747-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:39 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446
Nov 05 03:40:39 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:39 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446" returned: 0 in 0.561s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:39 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 1G
Nov 05 03:40:39 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:40 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 1G" returned: 0 in 0.695s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e4b236-3749-4746-9bfc-ec987ceab446 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:40 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e4b236-3749-4746-9bfc-ec987ceab446 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9
Nov 05 03:40:40 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:40 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e4b236-3749-4746-9bfc-ec987ceab446 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9" returned: 0 in 0.590s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:40 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:40:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:40 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9
Nov 05 03:40:40 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:41 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:41 devstack sudo[88796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info
Nov 05 03:40:41 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:41 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info" returned: 0 in 0.359s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:41 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:40:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:41 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info
Nov 05 03:40:41 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:42 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.info" returned: 0 in 0.286s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.129s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-48b77c35-c4f7-403c-bc14-58c1360f7cf9 tempest-GroupSnapshotsV319Test-1287296010 None] group_snapshot 3247fa9e-7f7d-41d0-8dad-7c0014633a29: created successfully
Nov 05 03:40:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] group_snapshot 3247fa9e-7f7d-41d0-8dad-7c0014633a29: deleting
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] group_snapshot 3247fa9e-7f7d-41d0-8dad-7c0014633a29: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "cinder-quobyte-b7e4b236-3749-4746-9bfc-ec987ceab446" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "cinder-quobyte-b7e4b236-3749-4746-9bfc-ec987ceab446" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "cinder-quobyte-b18e001b-8739-4f3e-a081-fb678d285ce9" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "cinder-quobyte-b18e001b-8739-4f3e-a081-fb678d285ce9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Deleting offline snapshot b18e001b-8739-4f3e-a081-fb678d285ce9 of volume b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] snapshot_file for this snap is: volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1257de9-c9ff-4b6d-bf43-5d2c9e921fc0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:44 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9
Nov 05 03:40:44 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:44 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e4b236-3749-4746-9bfc-ec987ceab446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0fb295-f3b7-4ac5-9338-638eebc18e90]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:45 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446
Nov 05 03:40:45 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:45 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446" returned: 0 in 0.647s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:45 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9
Nov 05 03:40:45 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:46 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9" returned: 0 in 0.548s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:46 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9
Nov 05 03:40:46 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:46 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446.b18e001b-8739-4f3e-a081-fb678d285ce9" returned: 0 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "cinder-quobyte-b18e001b-8739-4f3e-a081-fb678d285ce9" released by "_delete_snapshot" :: held 2.192s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "cinder-quobyte-b7e4b236-3749-4746-9bfc-ec987ceab446" released by "delete_snapshot" :: held 2.225s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:46 devstack cinder-volume[87098]: WARNING cinder.quota [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-932985018 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-932985018, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:40:46 devstack cinder-volume[87098]: WARNING cinder.quota [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-932985018 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-932985018, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:40:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] Created reservations ['eb9d2785-0463-44ae-9646-57c98e063041', '616cf328-7d0c-430c-837e-cce578adb77f', 'cf134f3f-4a72-4813-b506-13c59ac8c4e5', 'aadf685a-5553-4f78-a457-07305a35ca28'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:40:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a4487cc5-b15a-4fec-91b8-91cb18ad8db9 tempest-GroupSnapshotsV319Test-1287296010 None] group_snapshot 3247fa9e-7f7d-41d0-8dad-7c0014633a29: deleted successfully
Nov 05 03:40:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "cinder-quobyte-b7e4b236-3749-4746-9bfc-ec987ceab446" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:40:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "cinder-quobyte-b7e4b236-3749-4746-9bfc-ec987ceab446" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:40:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee2eff-40a3-4552-87e5-38fdb6f629c4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:40:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:48 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446
Nov 05 03:40:48 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:48 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:48 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446
Nov 05 03:40:48 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:49 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e4b236-3749-4746-9bfc-ec987ceab446" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "cinder-quobyte-b7e4b236-3749-4746-9bfc-ec987ceab446" released by "delete_volume" :: held 0.949s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Created reservations ['4cb5c554-7e50-4a46-9bd9-88a810c07ab3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:40:49 devstack cinder-volume[87098]: WARNING cinder.quota [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-932985018 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-932985018, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Created reservations ['dea545bb-abea-4285-b927-6b2ce482496d', '7262f41d-7be0-436b-a556-82d77064d923', 'c048a9eb-a06e-494d-994f-526007b5b0c6', '6df70164-7ee2-4bcc-9422-5b6f3e7a249c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:40:49 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:40:49 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:40:49 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.331s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:40:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:40:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e88ee040-3ef9-4298-b069-7628bf478f94 tempest-GroupSnapshotsV319Test-1287296010 None] Delete group completed successfully.
Nov 05 03:40:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:40:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=3,cinder:SELECT=53 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:08 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:41:08 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b91bb836-966f-4c69-a798-6e1ddd9d3fda tempest-GroupsV314Test-10738739 None] Group tempest-GroupsV314Test-Group-2096886597: creating
Nov 05 03:41:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b91bb836-966f-4c69-a798-6e1ddd9d3fda tempest-GroupsV314Test-10738739 None] Group tempest-GroupsV314Test-Group-2096886597: created successfully
Nov 05 03:41:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b91bb836-966f-4c69-a798-6e1ddd9d3fda tempest-GroupsV314Test-10738739 None] Create group completed successfully.
Nov 05 03:41:09 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:41:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:41:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:41:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Flow 'volume_create_manager' (5be4994c-7d62-435a-b790-b5705ab4e05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3064ee59-3122-40c0-844e-3cdb6b035dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3064ee59-3122-40c0-844e-3cdb6b035dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012928457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=532a267b-b851-4c9a-9f92-23979ce2f978,host='devstack@QuobyteHD#QuobyteHD',id=8a8c3bdb-0199-4467-ad7c-074d22ca471b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c65a6f233648499e8155ff0cab3a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:11Z,use_quota=True,user_id='9b50d235c036404fa020cbdad81b018f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19d34e23-733c-48c9-8a8d-b8edd793b46d),volume_type_id=19d34e23-733c-48c9-8a8d-b8edd793b46d)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5530af6-e3ae-4c3d-bf91-239d245582af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5530af6-e3ae-4c3d-bf91-239d245582af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c31254-195d-415b-b7be-3039d2e19ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c31254-195d-415b-b7be-3039d2e19ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8c3bdb-0199-4467-ad7c-074d22ca471b', 'volume_name': 'volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0809e40-b25e-4abf-8bd1-41f4d24d19bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0809e40-b25e-4abf-8bd1-41f4d24d19bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a323b9-9f58-4062-afff-1e65f84132f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:10 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Volume 8a8c3bdb-0199-4467-ad7c-074d22ca471b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b', 'volume_size': 1}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=532a267b-b851-4c9a-9f92-23979ce2f978,created_at=2026-11-05T02:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012928457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=532a267b-b851-4c9a-9f92-23979ce2f978,host='devstack@QuobyteHD#QuobyteHD',id=8a8c3bdb-0199-4467-ad7c-074d22ca471b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c65a6f233648499e8155ff0cab3a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:11Z,use_quota=True,user_id='9b50d235c036404fa020cbdad81b018f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19d34e23-733c-48c9-8a8d-b8edd793b46d),volume_type_id=19d34e23-733c-48c9-8a8d-b8edd793b46d)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Creating volume 8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:41:10 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:41:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:10 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b 1073741824
Nov 05 03:41:10 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:11 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b 1073741824" returned: 0 in 0.587s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:11 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b
Nov 05 03:41:11 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:11 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a323b9-9f58-4062-afff-1e65f84132f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4ec136-ce28-479a-a6c6-b56b8d9e966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Volume volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b (8a8c3bdb-0199-4467-ad7c-074d22ca471b): created successfully
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4ec136-ce28-479a-a6c6-b56b8d9e966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Flow 'volume_create_manager' (5be4994c-7d62-435a-b790-b5705ab4e05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8eb4a71f-694a-4531-bce9-a6296708bdce tempest-GroupsV314Test-10738739 None] Created volume successfully.
Nov 05 03:41:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:14 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Cloning volume 8a8c3bdb-0199-4467-ad7c-074d22ca471b to volume 3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844
Nov 05 03:41:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Creating offline snapshot 4b274d1c-7ece-4cee-9f85-e7cd2171e46c of volume 8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:41:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b97223-0693-444d-aea8-067341a63d78]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:14 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b
Nov 05 03:41:14 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:15 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b" returned: 0 in 0.750s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:15 devstack sudo[88921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c 1G
Nov 05 03:41:15 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:15 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c 1G" returned: 0 in 0.753s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:16 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c
Nov 05 03:41:16 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:16 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:16 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:41:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:16 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c
Nov 05 03:41:16 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:16 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:17 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info
Nov 05 03:41:17 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:17 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:17 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:17 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info
Nov 05 03:41:17 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:17 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.info" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Acquiring lock "cinder-quobyte-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] snapshot: 4b274d1c-7ece-4cee-9f85-e7cd2171e46c, volume: 3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7ff3d3-d266-4b0f-b74d-5fadb72a108c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:18 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c
Nov 05 03:41:18 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:18 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:41:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a44d14-113f-4f80-a534-edebef34481d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:18 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b
Nov 05 03:41:18 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:19 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b" returned: 0 in 0.584s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:41:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:41:19 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:41:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:19 devstack sudo[88970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844
Nov 05 03:41:19 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:26 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=4,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:41:26 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:41:27 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" returned: 0 in 8.964s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:41:28 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Converted 1024.00 MB image at 114.19 MB/s
Nov 05 03:41:28 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Flow 'volume_create_manager' (0314aa19-c313-4e53-94ce-9f493b5f0f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:28 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844
Nov 05 03:41:28 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7f3c80-5fbc-467b-a7a0-0ea8329a4da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7f3c80-5fbc-467b-a7a0-0ea8329a4da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1188008026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b773f-2d43-4f36-a08d-d354fd9f7e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f88cf9ed6934a779607e95f14eeff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:28Z,use_quota=True,user_id='462aaef5c752452c8899e269a6e1a9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d6a510-855f-4f8c-9ad6-a733ff5e518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d6a510-855f-4f8c-9ad6-a733ff5e518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8fd4fe-8958-40ed-8f8b-e3596e41a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8fd4fe-8958-40ed-8f8b-e3596e41a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188b773f-2d43-4f36-a08d-d354fd9f7e00', 'volume_name': 'volume-188b773f-2d43-4f36-a08d-d354fd9f7e00', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f0bc77-4da6-435e-88d2-57c101a7af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f0bc77-4da6-435e-88d2-57c101a7af1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d67656-0373-4919-98f9-d6bcaab63e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Volume 188b773f-2d43-4f36-a08d-d354fd9f7e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188b773f-2d43-4f36-a08d-d354fd9f7e00', 'volume_size': 1}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:28 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" returned: 0 in 0.568s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" released by "_copy_volume_from_snapshot" :: held 10.694s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Acquiring lock "cinder-quobyte-4b274d1c-7ece-4cee-9f85-e7cd2171e46c" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-4b274d1c-7ece-4cee-9f85-e7cd2171e46c" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Deleting offline snapshot 4b274d1c-7ece-4cee-9f85-e7cd2171e46c of volume 8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] snapshot_file for this snap is: volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e99c427-d136-4f38-b85f-1e22bdcfee79]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:28 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c
Nov 05 03:41:28 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:29 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c" returned: 0 in 0.696s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:41:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dce61e-c2de-4e18-9e10-2a12e2169908]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:29 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b
Nov 05 03:41:29 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:30 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b" returned: 0 in 0.927s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:30 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c
Nov 05 03:41:30 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:31 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c" returned: 0 in 0.555s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:31 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c
Nov 05 03:41:31 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:31 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b.4b274d1c-7ece-4cee-9f85-e7cd2171e46c" returned: 0 in 0.392s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-4b274d1c-7ece-4cee-9f85-e7cd2171e46c" released by "_delete_snapshot" :: held 2.779s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.195s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.296s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1188008026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b773f-2d43-4f36-a08d-d354fd9f7e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f88cf9ed6934a779607e95f14eeff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:28Z,use_quota=True,user_id='462aaef5c752452c8899e269a6e1a9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Creating volume 188b773f-2d43-4f36-a08d-d354fd9f7e00 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:41:31 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:41:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:31 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 1073741824
Nov 05 03:41:31 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b84a48c1-06bc-4012-a9a5-9622c2a1ef59 tempest-GroupsV314Test-10738739 None] Create group from source-group-532a267b-b851-4c9a-9f92-23979ce2f978 completed successfully.
Nov 05 03:41:32 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 1073741824" returned: 0 in 0.848s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:32 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00
Nov 05 03:41:32 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Acquiring lock "cinder-quobyte-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" acquired by "delete_volume" :: waited 0.057s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:33 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00" returned: 0 in 0.661s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88f055-c8f4-424a-885a-b7c69a94bf21]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d67656-0373-4919-98f9-d6bcaab63e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188b773f-2d43-4f36-a08d-d354fd9f7e00', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b68486-0be9-46eb-826f-cb52feb8b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Volume volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 (188b773f-2d43-4f36-a08d-d354fd9f7e00): created successfully
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b68486-0be9-46eb-826f-cb52feb8b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Flow 'volume_create_manager' (0314aa19-c313-4e53-94ce-9f493b5f0f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1117a2ed-8f8f-4b43-9b69-118155481f1d tempest-TaggedAttachmentsTest-245684427 None] Created volume successfully.
Nov 05 03:41:33 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844
Nov 05 03:41:33 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:33 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" returned: 0 in 0.572s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:33 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844
Nov 05 03:41:33 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:34 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-3e0e79e4-f1b4-4cb2-bddf-6e1ae8eb8844" released by "delete_volume" :: held 1.004s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Created reservations ['b5697936-de29-437b-b086-4609e469490e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:41:34 devstack cinder-volume[87098]: WARNING cinder.quota [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-470539330 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-470539330, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:41:34 devstack cinder-volume[87098]: WARNING cinder.quota [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-470539330 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-470539330, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Created reservations ['d5d5a8eb-e511-4e81-8cb1-6ad7e69dc05d', '564cff2c-837e-445a-a563-047f6765b012', 'e550e573-1cb6-4188-a60b-256a9c6f4fa2', '14e0c8e4-7a61-425e-b6b9-e34e5066be9f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:34 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:41:34 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:34 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:41:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ead44880-e687-4f15-a019-e73febdeb006 tempest-GroupsV314Test-10738739 None] Delete group completed successfully.
Nov 05 03:41:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Acquiring lock "cinder-quobyte-8a8c3bdb-0199-4467-ad7c-074d22ca471b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:41:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-8a8c3bdb-0199-4467-ad7c-074d22ca471b" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:41:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019b669-4333-4473-abc8-31c200d4ff8a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:41:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:36 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b
Nov 05 03:41:36 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:36 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b" returned: 0 in 0.719s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:36 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b
Nov 05 03:41:36 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:37 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a8c3bdb-0199-4467-ad7c-074d22ca471b" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Lock "cinder-quobyte-8a8c3bdb-0199-4467-ad7c-074d22ca471b" released by "delete_volume" :: held 1.281s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Created reservations ['6a60848c-f3c3-4420-9ace-0709a4c8f159'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Created reservations ['8e1fe793-417a-409b-9645-36e01219b5e4', '62d073d7-e5f1-400d-b6fa-1414720a4793', 'bb4ba19e-a05d-4d77-9909-ab18fc9c7535', '2b5363b9-3796-4238-887b-67c25d44fcfb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:37 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:41:37 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:38 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.476s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:41:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f810bc4d-9a03-45b1-959b-7d2c5638a26e tempest-GroupsV314Test-10738739 None] Delete group completed successfully.
Nov 05 03:41:47 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=6 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:41:47 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=32,cinder:SELECT=19,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Flow 'volume_create_manager' (5bb48c44-7d87-47fe-8dc7-79530bdba592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e87b03c-4c76-4e1e-9533-0ed4a8e2da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e87b03c-4c76-4e1e-9533-0ed4a8e2da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1600591685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3348a013-75a6-4898-aeef-3d9d13740b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0210d97d27349f0bd4e377f0e1c4efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:57Z,use_quota=True,user_id='0ca6c4b242bc44dcbaeb600d5928f11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b761c2-3248-4f27-a163-1303bc63db3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b761c2-3248-4f27-a163-1303bc63db3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0efd562-4f95-4fa5-b4e2-09027a2051fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0efd562-4f95-4fa5-b4e2-09027a2051fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3348a013-75a6-4898-aeef-3d9d13740b2d', 'volume_name': 'volume-3348a013-75a6-4898-aeef-3d9d13740b2d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb60024-0523-4b17-a0da-46a25262723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb60024-0523-4b17-a0da-46a25262723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67d7311-7382-4394-a889-d76e44f5be80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Volume 3348a013-75a6-4898-aeef-3d9d13740b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3348a013-75a6-4898-aeef-3d9d13740b2d', 'volume_size': 1}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1600591685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3348a013-75a6-4898-aeef-3d9d13740b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0210d97d27349f0bd4e377f0e1c4efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:57Z,use_quota=True,user_id='0ca6c4b242bc44dcbaeb600d5928f11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Creating volume 3348a013-75a6-4898-aeef-3d9d13740b2d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:41:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:41:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:57 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d 1073741824
Nov 05 03:41:57 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:58 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d 1073741824" returned: 0 in 0.780s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:41:58 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d
Nov 05 03:41:58 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:41:59 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d" returned: 0 in 0.502s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67d7311-7382-4394-a889-d76e44f5be80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3348a013-75a6-4898-aeef-3d9d13740b2d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94baf981-0361-4fd4-ab89-2cefe506d62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:41:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Volume volume-3348a013-75a6-4898-aeef-3d9d13740b2d (3348a013-75a6-4898-aeef-3d9d13740b2d): created successfully
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94baf981-0361-4fd4-ab89-2cefe506d62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:41:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Flow 'volume_create_manager' (5bb48c44-7d87-47fe-8dc7-79530bdba592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:41:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-35801811-00fe-4f66-970e-a1f5f1b87584 tempest-ServerActionsTestOtherA-813450021 None] Created volume successfully.
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:08 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:42:08 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:42:09 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:42:09 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.856s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Flow 'volume_create_manager' (8fbecfb9-f678-4e6c-bfd2-0c3636b4b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2e7675-2c36-41cd-bb98-db37d99a87e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2e7675-2c36-41cd-bb98-db37d99a87e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1712431167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49cd659-c0a5-4b7e-a68e-8a949d720da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16c95f14143421693d243300056da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:27Z,use_quota=True,user_id='f31da834d87a44708a647edfb30a79e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6750fa57-7b91-4ad7-9183-e0884b1519a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6750fa57-7b91-4ad7-9183-e0884b1519a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef1c667-791c-4e5f-9252-3a51238fa8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef1c667-791c-4e5f-9252-3a51238fa8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49cd659-c0a5-4b7e-a68e-8a949d720da8', 'volume_name': 'volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df661cf-033e-41f2-9580-aa858bcddeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df661cf-033e-41f2-9580-aa858bcddeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a6055c-f6d5-4a72-a9e9-a85fb77183ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Volume e49cd659-c0a5-4b7e-a68e-8a949d720da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8', 'volume_size': 1}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1712431167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49cd659-c0a5-4b7e-a68e-8a949d720da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16c95f14143421693d243300056da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:27Z,use_quota=True,user_id='f31da834d87a44708a647edfb30a79e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Creating volume e49cd659-c0a5-4b7e-a68e-8a949d720da8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:27 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 1073741824
Nov 05 03:42:27 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:27 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 1073741824" returned: 0 in 0.869s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:28 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8
Nov 05 03:42:28 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:28 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8" returned: 0 in 0.704s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a6055c-f6d5-4a72-a9e9-a85fb77183ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a22787b-9959-40b2-8657-8663f58f56f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Volume volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 (e49cd659-c0a5-4b7e-a68e-8a949d720da8): created successfully
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a22787b-9959-40b2-8657-8663f58f56f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Flow 'volume_create_manager' (8fbecfb9-f678-4e6c-bfd2-0c3636b4b58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-67304322-644d-4b81-84d5-7e34dc6527c1 tempest-ServersNegativeTestJSON-383748179 None] Created volume successfully.
Nov 05 03:42:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-65c2805c-f219-402b-b869-4b25784ce925 req-f0cf2ebd-6472-45f4-90e3-268abab46d12 tempest-TaggedAttachmentsTest-245684427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-65c2805c-f219-402b-b869-4b25784ce925 req-f0cf2ebd-6472-45f4-90e3-268abab46d12 tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-65c2805c-f219-402b-b869-4b25784ce925 req-f0cf2ebd-6472-45f4-90e3-268abab46d12 tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-65c2805c-f219-402b-b869-4b25784ce925 req-f0cf2ebd-6472-45f4-90e3-268abab46d12 tempest-TaggedAttachmentsTest-245684427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-188b773f-2d43-4f36-a08d-d354fd9f7e00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '238fd13f-2abb-4a4f-9039-c3799e20f7dc', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:42:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-65c2805c-f219-402b-b869-4b25784ce925 req-f0cf2ebd-6472-45f4-90e3-268abab46d12 tempest-TaggedAttachmentsTest-245684427 None] attachment_update completed successfully.
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Flow 'volume_create_manager' (de782b9f-6c87-4922-ab37-103b8fa8cdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0367bbe-214f-4d27-b4d6-1c2a14c170a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0367bbe-214f-4d27-b4d6-1c2a14c170a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-311763329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b51f57d-6581-4b45-b142-a80859338de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16c95f14143421693d243300056da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:32Z,use_quota=True,user_id='f31da834d87a44708a647edfb30a79e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a0b585-a1d7-49c1-b9b7-99ff5ec23135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a0b585-a1d7-49c1-b9b7-99ff5ec23135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7660a5-2b05-454d-b694-7a014081c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7660a5-2b05-454d-b694-7a014081c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b51f57d-6581-4b45-b142-a80859338de9', 'volume_name': 'volume-0b51f57d-6581-4b45-b142-a80859338de9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc27bdf-922d-45dd-80e0-7742513c8b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc27bdf-922d-45dd-80e0-7742513c8b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbf779f-33fb-41e3-8bec-edffd707b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Volume 0b51f57d-6581-4b45-b142-a80859338de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b51f57d-6581-4b45-b142-a80859338de9', 'volume_size': 1}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-311763329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b51f57d-6581-4b45-b142-a80859338de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16c95f14143421693d243300056da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:32Z,use_quota=True,user_id='f31da834d87a44708a647edfb30a79e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Creating volume 0b51f57d-6581-4b45-b142-a80859338de9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:42:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:32 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9 1073741824
Nov 05 03:42:32 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:32 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9 1073741824" returned: 0 in 0.769s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:32 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9
Nov 05 03:42:32 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:33 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbf779f-33fb-41e3-8bec-edffd707b78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b51f57d-6581-4b45-b142-a80859338de9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b3ac1c-ef7a-4ac5-8b92-7b7edc4e9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Volume volume-0b51f57d-6581-4b45-b142-a80859338de9 (0b51f57d-6581-4b45-b142-a80859338de9): created successfully
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b3ac1c-ef7a-4ac5-8b92-7b7edc4e9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Flow 'volume_create_manager' (de782b9f-6c87-4922-ab37-103b8fa8cdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c5cb957e-9292-4a70-bd37-7c2c36401195 tempest-ServersNegativeTestJSON-383748179 None] Created volume successfully.
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "cinder-0b51f57d-6581-4b45-b142-a80859338de9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-0b51f57d-6581-4b45-b142-a80859338de9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "cinder-quobyte-0b51f57d-6581-4b45-b142-a80859338de9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-quobyte-0b51f57d-6581-4b45-b142-a80859338de9" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[207dff73-45fc-414c-93a3-5b9d97877abf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-7d94373b-3eef-4f19-bb54-393ada6ec6f7 req-bcb22b01-6391-4dee-97d4-8fc27fca1926 tempest-TaggedAttachmentsTest-245684427 None] Terminate volume connection completed successfully.
Nov 05 03:42:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7d94373b-3eef-4f19-bb54-393ada6ec6f7 req-bcb22b01-6391-4dee-97d4-8fc27fca1926 tempest-TaggedAttachmentsTest-245684427 None] Deleting attachment 238fd13f-2abb-4a4f-9039-c3799e20f7dc. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:42:34 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9
Nov 05 03:42:34 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:35 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9" returned: 0 in 0.537s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:35 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9
Nov 05 03:42:35 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:35 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0b51f57d-6581-4b45-b142-a80859338de9" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-quobyte-0b51f57d-6581-4b45-b142-a80859338de9" released by "delete_volume" :: held 0.884s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Created reservations ['2c5ff4b8-77a5-48f6-a20c-36a80ccf5cab', '1fae7400-214e-488a-b141-6d0fb5493086', 'b83a4227-10b1-48a6-b250-fb0c0a5b7f62', 'e4bea3e0-df35-48d8-86c0-c9f625cf1cec'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:35 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:42:35 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "cinder-e49cd659-c0a5-4b7e-a68e-8a949d720da8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-e49cd659-c0a5-4b7e-a68e-8a949d720da8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "cinder-quobyte-e49cd659-c0a5-4b7e-a68e-8a949d720da8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-quobyte-e49cd659-c0a5-4b7e-a68e-8a949d720da8" acquired by "delete_volume" :: waited 0.053s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8307f1b-2854-495c-a3fc-a45450edf359]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:36 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.505s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Deleted volume successfully.
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-701e38ce-4730-4c51-8e1f-1c8e569b6673 tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-0b51f57d-6581-4b45-b142-a80859338de9-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:36 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8
Nov 05 03:42:36 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:36 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8" returned: 0 in 0.670s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:36 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8
Nov 05 03:42:36 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:37 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e49cd659-c0a5-4b7e-a68e-8a949d720da8" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-quobyte-e49cd659-c0a5-4b7e-a68e-8a949d720da8" released by "delete_volume" :: held 1.195s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Created reservations ['7aa42bc5-abc0-4824-80a5-3d01f4d7f0d1', '4a56eddb-edfd-4a6e-bb69-9180f34be578', 'be755f22-0c25-40cf-8772-aac0fe0b52f4', '9246276e-685f-4f57-bc71-3a5c29d14f34'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:37 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:42:37 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:37 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Deleted volume successfully.
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-736a7076-c88e-4b1c-b9d4-d9007f58417e tempest-ServersNegativeTestJSON-383748179 None] Lock "cinder-e49cd659-c0a5-4b7e-a68e-8a949d720da8-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Flow 'volume_create_manager' (ca48cba9-4a8e-417f-a00b-492bd4b871af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774d9114-5666-4929-bd01-fc2e4a18bc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774d9114-5666-4929-bd01-fc2e4a18bc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-510284795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8333d6d3-4c00-4b99-957e-6d2e75a4b45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76152afbfb79440e89b20b601e20f64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:38Z,use_quota=True,user_id='d12995c299cc4517b638a9c8f1609fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f1bad9-d7f5-4830-9126-cc6d6f0b5860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f1bad9-d7f5-4830-9126-cc6d6f0b5860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f152ced6-a072-45d4-9f9f-277d1518244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f152ced6-a072-45d4-9f9f-277d1518244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8333d6d3-4c00-4b99-957e-6d2e75a4b45f', 'volume_name': 'volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3487f930-00a8-4b90-9c63-566f2ad3e379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3487f930-00a8-4b90-9c63-566f2ad3e379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa149916-43cd-464d-b907-607fffefef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Volume 8333d6d3-4c00-4b99-957e-6d2e75a4b45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f', 'volume_size': 1}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-510284795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8333d6d3-4c00-4b99-957e-6d2e75a4b45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76152afbfb79440e89b20b601e20f64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:38Z,use_quota=True,user_id='d12995c299cc4517b638a9c8f1609fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Creating volume 8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:37 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:42:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:38 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f 1073741824
Nov 05 03:42:38 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:38 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f 1073741824" returned: 0 in 0.589s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:38 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f
Nov 05 03:42:38 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:39 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa149916-43cd-464d-b907-607fffefef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6a026c-c74b-4713-8dcd-2e3c6bd78791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Volume volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f (8333d6d3-4c00-4b99-957e-6d2e75a4b45f): created successfully
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6a026c-c74b-4713-8dcd-2e3c6bd78791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Flow 'volume_create_manager' (ca48cba9-4a8e-417f-a00b-492bd4b871af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1cf25dcd-7e5f-4261-b6cf-ba6cc8bbd10f tempest-SnapshotMetadataTestJSON-556253371 None] Created volume successfully.
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Creating offline snapshot 73a4f397-74b1-45cc-b0d6-57af82570cf3 of volume 8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f10915b-da5a-4b94-96af-8b89c8e6666d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:41 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f
Nov 05 03:42:41 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:41 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" returned: 0 in 0.820s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:41 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 1G
Nov 05 03:42:41 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:42 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 1G" returned: 0 in 0.561s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:42 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3
Nov 05 03:42:42 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:42 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:42 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 is being set with open permissions: ugo+rw
Nov 05 03:42:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:42 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3
Nov 05 03:42:42 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:43 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:43 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info
Nov 05 03:42:43 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:43 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:43 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info is being set with open permissions: ugo+rw
Nov 05 03:42:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:43 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info
Nov 05 03:42:43 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:43 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.info" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d1c3e804-1b38-44bd-be93-bbeb0c40ee5f tempest-SnapshotMetadataTestJSON-556253371 None] Create snapshot completed successfully
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "cinder-73a4f397-74b1-45cc-b0d6-57af82570cf3-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-73a4f397-74b1-45cc-b0d6-57af82570cf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "cinder-quobyte-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-quobyte-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "cinder-quobyte-73a4f397-74b1-45cc-b0d6-57af82570cf3" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-quobyte-73a4f397-74b1-45cc-b0d6-57af82570cf3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Deleting offline snapshot 73a4f397-74b1-45cc-b0d6-57af82570cf3 of volume 8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] snapshot_file for this snap is: volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2631211f-a0cc-41a8-ac2e-4cd9bc4763df]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:45 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3
Nov 05 03:42:45 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:45 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3" returned: 0 in 0.425s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[be469af4-92a0-47a6-8fff-77f97ce41d7d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:46 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f
Nov 05 03:42:46 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:46 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" returned: 0 in 0.586s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:46 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3
Nov 05 03:42:46 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:47 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:47 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3
Nov 05 03:42:47 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:47 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f.73a4f397-74b1-45cc-b0d6-57af82570cf3" returned: 0 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-quobyte-73a4f397-74b1-45cc-b0d6-57af82570cf3" released by "_delete_snapshot" :: held 2.134s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-quobyte-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" released by "delete_snapshot" :: held 2.176s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Acquiring lock "cinder-188b773f-2d43-4f36-a08d-d354fd9f7e00-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Lock "cinder-188b773f-2d43-4f36-a08d-d354fd9f7e00-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:47 devstack cinder-volume[87098]: WARNING cinder.quota [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Created reservations ['df2e6003-8065-4ce4-8981-1dada88e19b7', 'eef6294a-b031-4772-9c0b-f33782e56d9a', 'd80ce530-852e-4450-a9df-ab2e09300430', '0f989c8f-84a9-49e0-802f-055a50cdac41'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Acquiring lock "cinder-quobyte-188b773f-2d43-4f36-a08d-d354fd9f7e00" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Lock "cinder-quobyte-188b773f-2d43-4f36-a08d-d354fd9f7e00" acquired by "delete_volume" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfffb24d-1391-4e93-ad6a-313bc069baab]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Delete snapshot completed successfully.
Nov 05 03:42:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0ae9259b-23a3-44de-b49b-0f36bcbdd195 tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-73a4f397-74b1-45cc-b0d6-57af82570cf3-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:47 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00
Nov 05 03:42:47 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:48 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:48 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00
Nov 05 03:42:48 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:48 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-188b773f-2d43-4f36-a08d-d354fd9f7e00" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Lock "cinder-quobyte-188b773f-2d43-4f36-a08d-d354fd9f7e00" released by "delete_volume" :: held 0.848s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "cinder-8333d6d3-4c00-4b99-957e-6d2e75a4b45f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-8333d6d3-4c00-4b99-957e-6d2e75a4b45f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Created reservations ['03067182-2a77-47ef-90fc-07599865b78c', 'd1186678-3a92-4ef6-8a5d-d9268342feb8', 'c74ea532-df6c-425f-adb7-57699c754343', 'd9e3cc16-ff1e-4e5c-87a6-c602f19503d6'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "cinder-quobyte-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-quobyte-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2adf92a-c390-44e7-8c05-37dbfe379510]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-cd179a0a-d949-4066-9128-7ea2e54630b1 req-81c7feed-68b3-4f27-bf81-b4f749cafc9e tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-cd179a0a-d949-4066-9128-7ea2e54630b1 req-81c7feed-68b3-4f27-bf81-b4f749cafc9e tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-cd179a0a-d949-4066-9128-7ea2e54630b1 req-81c7feed-68b3-4f27-bf81-b4f749cafc9e tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:49 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:42:49 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-cd179a0a-d949-4066-9128-7ea2e54630b1 req-81c7feed-68b3-4f27-bf81-b4f749cafc9e tempest-ServerActionsTestOtherA-813450021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-3348a013-75a6-4898-aeef-3d9d13740b2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34f8ef19-386e-4ff3-882b-ad267c629fc3', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:42:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-cd179a0a-d949-4066-9128-7ea2e54630b1 req-81c7feed-68b3-4f27-bf81-b4f749cafc9e tempest-ServerActionsTestOtherA-813450021 None] attachment_update completed successfully.
Nov 05 03:42:49 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f
Nov 05 03:42:49 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:49 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Deleted volume successfully.
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-92e56999-942a-414c-919d-aa6a0d069e3a tempest-TaggedAttachmentsTest-245684427 None] Lock "cinder-188b773f-2d43-4f36-a08d-d354fd9f7e00-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:49 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" returned: 0 in 0.663s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:49 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f
Nov 05 03:42:49 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:50 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-quobyte-8333d6d3-4c00-4b99-957e-6d2e75a4b45f" released by "delete_volume" :: held 1.207s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Created reservations ['87b56743-12f2-4901-b083-e15bd1f96a4a', '98da4d6c-5033-4b0e-ba8f-d96542665baf', 'cefca806-8fac-4277-99e6-0804495ffc50', '6c9c650c-0ede-4486-921b-b521ceecc9a4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:50 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:42:50 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:42:50 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:42:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Deleted volume successfully.
Nov 05 03:42:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-94353c8a-14c7-4fe7-89b8-0769efa92b9e tempest-SnapshotMetadataTestJSON-556253371 None] Lock "cinder-8333d6d3-4c00-4b99-957e-6d2e75a4b45f-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:42:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-2cc01155-9ef9-42eb-8273-02358731a059 req-ce0e30dc-b7f5-490b-8885-824c9a9805b4 tempest-ServerActionsTestOtherA-813450021 None] Terminate volume connection completed successfully.
Nov 05 03:42:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-2cc01155-9ef9-42eb-8273-02358731a059 req-ce0e30dc-b7f5-490b-8885-824c9a9805b4 tempest-ServerActionsTestOtherA-813450021 None] Deleting attachment 34f8ef19-386e-4ff3-882b-ad267c629fc3. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:42:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2cc01155-9ef9-42eb-8273-02358731a059 req-3f782460-3ec6-4e93-9954-3cb21b972444 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2cc01155-9ef9-42eb-8273-02358731a059 req-3f782460-3ec6-4e93-9954-3cb21b972444 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2cc01155-9ef9-42eb-8273-02358731a059 req-3f782460-3ec6-4e93-9954-3cb21b972444 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-2cc01155-9ef9-42eb-8273-02358731a059 req-3f782460-3ec6-4e93-9954-3cb21b972444 tempest-ServerActionsTestOtherA-813450021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-3348a013-75a6-4898-aeef-3d9d13740b2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b9b26d4-845f-4ff9-b23e-0b92da627d2c', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:42:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-2cc01155-9ef9-42eb-8273-02358731a059 req-3f782460-3ec6-4e93-9954-3cb21b972444 tempest-ServerActionsTestOtherA-813450021 None] attachment_update completed successfully.
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Flow 'volume_create_manager' (42d3c132-d9a8-4642-98aa-a15984b9aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530d43b0-80e6-4ceb-a8f9-34b12aade135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530d43b0-80e6-4ceb-a8f9-34b12aade135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1951014171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42370bf-4209-4ac3-961f-d52ab24c1bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49549c444b5744ddbe1da20208bb3b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:59Z,use_quota=True,user_id='9c443d65748544d382e50f816b3cbe84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0424ced-d142-41b1-9890-a00543d3e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0424ced-d142-41b1-9890-a00543d3e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adec1e92-fc20-4aba-94fe-06602e62731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adec1e92-fc20-4aba-94fe-06602e62731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42370bf-4209-4ac3-961f-d52ab24c1bd9', 'volume_name': 'volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a52db6-40f3-4f61-810f-a6ee0ef47fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a52db6-40f3-4f61-810f-a6ee0ef47fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa5ca84-b74e-400a-a5b6-f88ceee35a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:42:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Volume b42370bf-4209-4ac3-961f-d52ab24c1bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9', 'volume_size': 1}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1951014171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42370bf-4209-4ac3-961f-d52ab24c1bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49549c444b5744ddbe1da20208bb3b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:59Z,use_quota=True,user_id='9c443d65748544d382e50f816b3cbe84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Creating volume b42370bf-4209-4ac3-961f-d52ab24c1bd9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:42:59 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:42:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:42:59 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 1073741824
Nov 05 03:42:59 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:00 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 1073741824" returned: 0 in 0.601s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:02 devstack sudo[91435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9
Nov 05 03:43:02 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:02 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9" returned: 0 in 0.279s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] <== create_volume: return (3132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.135s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa5ca84-b74e-400a-a5b6-f88ceee35a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a90a99-3118-44f5-8062-e2f9bf3c27e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Volume volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 (b42370bf-4209-4ac3-961f-d52ab24c1bd9): created successfully
Nov 05 03:43:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a90a99-3118-44f5-8062-e2f9bf3c27e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Flow 'volume_create_manager' (42d3c132-d9a8-4642-98aa-a15984b9aa82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4142f254-a9f7-4b22-8129-a623b7adaa63 tempest-AbsoluteLimitsTests-1692173950 None] Created volume successfully.
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Acquiring lock "cinder-b42370bf-4209-4ac3-961f-d52ab24c1bd9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Lock "cinder-b42370bf-4209-4ac3-961f-d52ab24c1bd9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Acquiring lock "cinder-quobyte-b42370bf-4209-4ac3-961f-d52ab24c1bd9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Lock "cinder-quobyte-b42370bf-4209-4ac3-961f-d52ab24c1bd9" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23ece1b-e1cd-4c33-85da-52010071a579]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:06 devstack sudo[91448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9
Nov 05 03:43:06 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:06 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9" returned: 0 in 0.627s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:06 devstack sudo[91453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9
Nov 05 03:43:06 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:07 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b42370bf-4209-4ac3-961f-d52ab24c1bd9" returned: 0 in 0.438s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Lock "cinder-quobyte-b42370bf-4209-4ac3-961f-d52ab24c1bd9" released by "delete_volume" :: held 1.153s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Created reservations ['e23f866d-7423-467b-ad94-0b8bab9ff6d1', '951ed89c-126d-449e-a74f-ab73b4571a26', '58982c89-a263-4cf8-82b7-312e908cff0e', 'f4407f8c-fe17-4784-a46d-c585d45b0b39'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:07 devstack sudo[91456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:07 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:08 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.503s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Deleted volume successfully.
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-733dd276-aa18-4814-ba12-48228ca77d71 tempest-AbsoluteLimitsTests-1692173950 None] Lock "cinder-b42370bf-4209-4ac3-961f-d52ab24c1bd9-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:08 devstack sudo[91460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:08 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:09 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.585s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:43:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 8 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:43:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=69,cinder:INSERT=13,cinder:UPDATE=58,cinder:DELETE=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=71,cinder:SELECT=70,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Flow 'volume_create_manager' (23e0bf12-910c-47be-8c6c-711c6a30a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae2bc21-cfcb-48c2-9297-275f44e5a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae2bc21-cfcb-48c2-9297-275f44e5a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1042845239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13e3e01-0946-4a0c-9e94-057ffbd45f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137c70a0d8b54e5c955ee6bcc3c3bd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:19Z,use_quota=True,user_id='fff20b7f34d24837bed7b06309fed6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492011e6-2a17-41ff-86bf-1fbe23b83036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492011e6-2a17-41ff-86bf-1fbe23b83036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db1479f-7ef1-48d0-b299-fbb1ca1874f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db1479f-7ef1-48d0-b299-fbb1ca1874f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13e3e01-0946-4a0c-9e94-057ffbd45f4e', 'volume_name': 'volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19584e6b-52f1-4620-b59b-2d733b77c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19584e6b-52f1-4620-b59b-2d733b77c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda1e54f-d772-4acb-b4ed-cbbec95f566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Volume c13e3e01-0946-4a0c-9e94-057ffbd45f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e', 'volume_size': 2}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1042845239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13e3e01-0946-4a0c-9e94-057ffbd45f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137c70a0d8b54e5c955ee6bcc3c3bd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:19Z,use_quota=True,user_id='fff20b7f34d24837bed7b06309fed6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Creating volume c13e3e01-0946-4a0c-9e94-057ffbd45f4e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e 2147483648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:19 devstack sudo[91536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e 2147483648
Nov 05 03:43:19 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Flow 'volume_create_manager' (b3fafdc4-35ac-4ab7-8cb0-97372da44abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd26316a-093d-4654-881b-91d7abb5a921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd26316a-093d-4654-881b-91d7abb5a921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1837218849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c127144-6a1d-4552-b511-a640b9e07875,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef6273a5437a4674b07e4a61caae542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:20Z,use_quota=True,user_id='4c0b76a0b6714dbaa9e287595319cbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f360c0-a199-4088-bff0-59936f50539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f360c0-a199-4088-bff0-59936f50539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c2f8ef-b447-4952-ae25-d32e34f508d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c2f8ef-b447-4952-ae25-d32e34f508d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c127144-6a1d-4552-b511-a640b9e07875', 'volume_name': 'volume-5c127144-6a1d-4552-b511-a640b9e07875', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f83ff93-241d-4b1d-974a-515a64f1d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f83ff93-241d-4b1d-974a-515a64f1d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58a0317-cae0-4df0-a177-19fcea84fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Volume 5c127144-6a1d-4552-b511-a640b9e07875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c127144-6a1d-4552-b511-a640b9e07875', 'volume_size': 1}
Nov 05 03:43:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:20 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e 2147483648" returned: 0 in 0.657s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:20 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e
Nov 05 03:43:20 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:20 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e" returned: 0 in 0.268s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1837218849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c127144-6a1d-4552-b511-a640b9e07875,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef6273a5437a4674b07e4a61caae542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:20Z,use_quota=True,user_id='4c0b76a0b6714dbaa9e287595319cbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Creating volume 5c127144-6a1d-4552-b511-a640b9e07875 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:20 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda1e54f-d772-4acb-b4ed-cbbec95f566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5294546-fab3-4736-87eb-f39738523c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:20 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875 1073741824
Nov 05 03:43:20 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Volume volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e (c13e3e01-0946-4a0c-9e94-057ffbd45f4e): created successfully
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5294546-fab3-4736-87eb-f39738523c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Flow 'volume_create_manager' (23e0bf12-910c-47be-8c6c-711c6a30a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7d404f5f-2ccd-4c06-a9f0-bb56ae59e996 tempest-VolumesCloneNegativeTest-1739404529 None] Created volume successfully.
Nov 05 03:43:21 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875 1073741824" returned: 0 in 0.550s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:21 devstack sudo[91554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875
Nov 05 03:43:21 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:21 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875" returned: 0 in 0.449s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Acquiring lock "cinder-c13e3e01-0946-4a0c-9e94-057ffbd45f4e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58a0317-cae0-4df0-a177-19fcea84fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c127144-6a1d-4552-b511-a640b9e07875', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17737e05-5298-49e8-8a13-b44318544a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Lock "cinder-c13e3e01-0946-4a0c-9e94-057ffbd45f4e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Volume volume-5c127144-6a1d-4552-b511-a640b9e07875 (5c127144-6a1d-4552-b511-a640b9e07875): created successfully
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17737e05-5298-49e8-8a13-b44318544a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Flow 'volume_create_manager' (b3fafdc4-35ac-4ab7-8cb0-97372da44abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-97d84898-9389-4d79-b5fd-143a08148334 tempest-VolumesTestJSON-1320271578 None] Created volume successfully.
Nov 05 03:43:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Acquiring lock "cinder-quobyte-c13e3e01-0946-4a0c-9e94-057ffbd45f4e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Lock "cinder-quobyte-c13e3e01-0946-4a0c-9e94-057ffbd45f4e" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8add30e7-c967-4084-8a44-f0200895c3fd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:22 devstack sudo[91561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e
Nov 05 03:43:22 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:22 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:22 devstack sudo[91566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e
Nov 05 03:43:22 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:22 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c13e3e01-0946-4a0c-9e94-057ffbd45f4e" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Lock "cinder-quobyte-c13e3e01-0946-4a0c-9e94-057ffbd45f4e" released by "delete_volume" :: held 0.930s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Created reservations ['04fb148c-543d-42ed-8643-3a491211f6b6', '5454e483-98f2-4086-8d84-d837ad7e343e', '0717b12b-4e44-49ef-be8c-1b59e4e2691c', '9d647ee0-2fbb-49f3-a972-0e5fcf76bcac'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:23 devstack sudo[91574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:23 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Flow 'volume_create_manager' (211dbf11-6cb7-4612-ab9e-b1e2cf94b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f767fd76-d0ed-4c2a-a42e-cfb4298085c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f767fd76-d0ed-4c2a-a42e-cfb4298085c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604797630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cfe722-0244-43c6-a8e6-cb7d390bd709,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef6273a5437a4674b07e4a61caae542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:23Z,use_quota=True,user_id='4c0b76a0b6714dbaa9e287595319cbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:23 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d704341e-16f9-4f88-8df2-d1f1d6f607d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d704341e-16f9-4f88-8df2-d1f1d6f607d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f87911a-dfec-483e-9903-ce45d73e80c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f87911a-dfec-483e-9903-ce45d73e80c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cfe722-0244-43c6-a8e6-cb7d390bd709', 'volume_name': 'volume-10cfe722-0244-43c6-a8e6-cb7d390bd709', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71de00a3-c740-46d6-b827-d56aeaee20a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71de00a3-c740-46d6-b827-d56aeaee20a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ecb04f-3ce7-4db5-8ae0-a61196162227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Volume 10cfe722-0244-43c6-a8e6-cb7d390bd709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cfe722-0244-43c6-a8e6-cb7d390bd709', 'volume_size': 1}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1604797630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cfe722-0244-43c6-a8e6-cb7d390bd709,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef6273a5437a4674b07e4a61caae542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:23Z,use_quota=True,user_id='4c0b76a0b6714dbaa9e287595319cbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Creating volume 10cfe722-0244-43c6-a8e6-cb7d390bd709 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:23 devstack sudo[91590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 1073741824
Nov 05 03:43:23 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Deleted volume successfully.
Nov 05 03:43:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-6eaa6f11-7276-4d8b-9a3f-0ae5a7e3f570 req-a998d5ff-0a95-4fb7-923f-5957cb8b66d6 tempest-ServerActionsTestOtherA-813450021 None] Terminate volume connection completed successfully.
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-6eaa6f11-7276-4d8b-9a3f-0ae5a7e3f570 req-a998d5ff-0a95-4fb7-923f-5957cb8b66d6 tempest-ServerActionsTestOtherA-813450021 None] Deleting attachment 0b9b26d4-845f-4ff9-b23e-0b92da627d2c. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:43:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c83aa705-20b8-458e-97d2-b40c2a4fff8b tempest-VolumesCloneNegativeTest-1739404529 None] Lock "cinder-c13e3e01-0946-4a0c-9e94-057ffbd45f4e-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:24 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 1073741824" returned: 0 in 0.845s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:24 devstack sudo[91599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709
Nov 05 03:43:24 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:24 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ecb04f-3ce7-4db5-8ae0-a61196162227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cfe722-0244-43c6-a8e6-cb7d390bd709', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5b5b1a-8e2a-4cf5-b494-c0446dac1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Volume volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 (10cfe722-0244-43c6-a8e6-cb7d390bd709): created successfully
Nov 05 03:43:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5b5b1a-8e2a-4cf5-b494-c0446dac1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Flow 'volume_create_manager' (211dbf11-6cb7-4612-ab9e-b1e2cf94b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8efec093-c2b5-444d-a0da-061b9d5eecd7 tempest-VolumesTestJSON-1320271578 None] Created volume successfully.
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Flow 'volume_create_manager' (16ab7f11-6eb8-4118-b778-3fb0a097c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c27e134-ab5e-48b3-b17d-d2aa815e2868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c27e134-ab5e-48b3-b17d-d2aa815e2868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-592816875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba89a0-5466-49e2-afde-26f44bf22ada,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef6273a5437a4674b07e4a61caae542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:26Z,use_quota=True,user_id='4c0b76a0b6714dbaa9e287595319cbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d559d6b8-6b7a-454e-9b43-a00bfbe3e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d559d6b8-6b7a-454e-9b43-a00bfbe3e794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41a33f4-e0e6-45bf-9b42-7d7638d630a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41a33f4-e0e6-45bf-9b42-7d7638d630a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fba89a0-5466-49e2-afde-26f44bf22ada', 'volume_name': 'volume-7fba89a0-5466-49e2-afde-26f44bf22ada', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a1b1d2-839c-4bac-9d57-56681c13512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a1b1d2-839c-4bac-9d57-56681c13512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66c08e6-aa37-4892-b9ca-738893c614e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Volume 7fba89a0-5466-49e2-afde-26f44bf22ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fba89a0-5466-49e2-afde-26f44bf22ada', 'volume_size': 1}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-592816875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fba89a0-5466-49e2-afde-26f44bf22ada,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef6273a5437a4674b07e4a61caae542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:26Z,use_quota=True,user_id='4c0b76a0b6714dbaa9e287595319cbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Creating volume 7fba89a0-5466-49e2-afde-26f44bf22ada {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:26 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:26 devstack sudo[91631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada 1073741824
Nov 05 03:43:26 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:27 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada 1073741824" returned: 0 in 0.601s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:27 devstack sudo[91639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada
Nov 05 03:43:27 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:27 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66c08e6-aa37-4892-b9ca-738893c614e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fba89a0-5466-49e2-afde-26f44bf22ada', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13892c83-aeaf-4aec-ad1a-8bdc1f87bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Volume volume-7fba89a0-5466-49e2-afde-26f44bf22ada (7fba89a0-5466-49e2-afde-26f44bf22ada): created successfully
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13892c83-aeaf-4aec-ad1a-8bdc1f87bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Flow 'volume_create_manager' (16ab7f11-6eb8-4118-b778-3fb0a097c651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3d3028b2-35d0-45a0-95bc-545dc733aa00 tempest-VolumesTestJSON-1320271578 None] Created volume successfully.
Nov 05 03:43:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Acquiring lock "cinder-7fba89a0-5466-49e2-afde-26f44bf22ada-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Lock "cinder-7fba89a0-5466-49e2-afde-26f44bf22ada-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Acquiring lock "cinder-quobyte-7fba89a0-5466-49e2-afde-26f44bf22ada" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Lock "cinder-quobyte-7fba89a0-5466-49e2-afde-26f44bf22ada" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e6b6c-668f-491c-a04e-1ee9411defb7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:30 devstack sudo[91709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada
Nov 05 03:43:30 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:31 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada" returned: 0 in 0.589s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:31 devstack sudo[91718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada
Nov 05 03:43:31 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:31 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7fba89a0-5466-49e2-afde-26f44bf22ada" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Lock "cinder-quobyte-7fba89a0-5466-49e2-afde-26f44bf22ada" released by "delete_volume" :: held 0.953s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Created reservations ['bdb829c0-e2c7-46a3-9e4b-ced7ac3a9677', 'c10eb812-6321-4455-b74f-c969e5acceb2', '618541c3-5e8a-4ebe-a5ca-ef3232656bfc', '1ff06bce-4b8e-4673-82ba-cf1537a76bd0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:31 devstack sudo[91721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:31 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:32 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Deleted volume successfully.
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "cinder-10cfe722-0244-43c6-a8e6-cb7d390bd709-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-97a5818c-0599-43eb-8db2-e6a23ff524ad tempest-VolumesTestJSON-1320271578 None] Lock "cinder-7fba89a0-5466-49e2-afde-26f44bf22ada-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Lock "cinder-10cfe722-0244-43c6-a8e6-cb7d390bd709-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "cinder-quobyte-10cfe722-0244-43c6-a8e6-cb7d390bd709" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Lock "cinder-quobyte-10cfe722-0244-43c6-a8e6-cb7d390bd709" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a489434-7994-430b-a92b-a95ad70d8aa0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Flow 'volume_create_manager' (3f6af48b-b299-4f3c-a5e1-d218b80928f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fad2294-2847-4790-8a81-0f544908b4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fad2294-2847-4790-8a81-0f544908b4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1880435055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de370899-1748-4bcd-b9fc-7a08b9096b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18858cb9390b49c6be0d1b1a916f2706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:32Z,use_quota=True,user_id='9eb50ddece434058aff4f63ca34110f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7efc57d-4605-4d46-b19a-3138561a666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7efc57d-4605-4d46-b19a-3138561a666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fc91f8-c669-45de-8a5c-8b2b3ba2f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:43:32 devstack sudo[91724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709
Nov 05 03:43:32 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Flow 'volume_create_manager' (22a65b5a-c9da-4d97-907a-096375c5838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52730a6-6af3-4d6c-bbb9-d2b93577b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52730a6-6af3-4d6c-bbb9-d2b93577b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1534809941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06bf5a9-3049-4a27-9280-4e08dc10d465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0210d97d27349f0bd4e377f0e1c4efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:33Z,use_quota=True,user_id='0ca6c4b242bc44dcbaeb600d5928f11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60fa897-c65f-4768-a934-9550eda1e563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60fa897-c65f-4768-a934-9550eda1e563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a8206-b57f-4044-98c2-99d1956a654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:32 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:43:33 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709" returned: 0 in 0.719s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:33 devstack sudo[91729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709
Nov 05 03:43:33 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fc91f8-c669-45de-8a5c-8b2b3ba2f620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de370899-1748-4bcd-b9fc-7a08b9096b57', 'volume_name': 'volume-de370899-1748-4bcd-b9fc-7a08b9096b57', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7351f2090>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d9fea8-ac44-49e2-a05f-b270d258a49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d9fea8-ac44-49e2-a05f-b270d258a49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06629f3-2550-4aeb-b074-ee0fcff00dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Volume de370899-1748-4bcd-b9fc-7a08b9096b57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de370899-1748-4bcd-b9fc-7a08b9096b57', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7351f2090>}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Trying to clone de370899-1748-4bcd-b9fc-7a08b9096b57 from image b168d99d-9565-4249-9e41-af4fab9708fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a8206-b57f-4044-98c2-99d1956a654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c06bf5a9-3049-4a27-9280-4e08dc10d465', 'volume_name': 'volume-c06bf5a9-3049-4a27-9280-4e08dc10d465', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7350c2bd0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39292bee-cd44-4776-9481-15796308a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39292bee-cd44-4776-9481-15796308a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e9acba-03c1-4c64-9274-9d91cccf3294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Volume c06bf5a9-3049-4a27-9280-4e08dc10d465: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c06bf5a9-3049-4a27-9280-4e08dc10d465', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7350c2bd0>}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Trying to clone c06bf5a9-3049-4a27-9280-4e08dc10d465 from image b168d99d-9565-4249-9e41-af4fab9708fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:43:33 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-10cfe722-0244-43c6-a8e6-cb7d390bd709" returned: 0 in 0.593s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Lock "cinder-quobyte-10cfe722-0244-43c6-a8e6-cb7d390bd709" released by "delete_volume" :: held 1.416s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Created reservations ['75dd7a09-04b0-4939-a494-7f4b6681807a', '2da126f5-551e-4869-85a8-85e4485ca356', 'dcea997d-1421-477b-931c-56c083b6189f', '7875911e-8769-462e-b090-2e8ef4710d76'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:43:34 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119346b-51f1-4968-b14c-d3248f1873dc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:43:34 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[200df9d4-3596-4c7c-8ce3-69b19be4db39]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:34 devstack sudo[91755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:34 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:34 devstack sudo[91756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:34 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:34 devstack sudo[91758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD
Nov 05 03:43:34 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Acquiring lock "cinder-5c127144-6a1d-4552-b511-a640b9e07875-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Lock "cinder-5c127144-6a1d-4552-b511-a640b9e07875-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Acquiring lock "cinder-quobyte-5c127144-6a1d-4552-b511-a640b9e07875" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:35 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD" returned: 0 in 0.689s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb is fetched for user 9eb50ddece434058aff4f63ca34110f6. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:43:35 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Lock "cinder-quobyte-5c127144-6a1d-4552-b511-a640b9e07875" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.613s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac3c762-ed39-42da-b73c-469ad31dc1b3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Deleted volume successfully.
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:35 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7233db14-43c8-4ad5-b3fb-476e917e3791 tempest-VolumesTestJSON-1320271578 None] Lock "cinder-10cfe722-0244-43c6-a8e6-cb7d390bd709-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb is fetched for user 0ca6c4b242bc44dcbaeb600d5928f11e. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d182c38f-e14e-4976-8ceb-f0315d3bc9b7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[245904ff-9e30-4d36-8188-e63164f7fd0b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:35 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875
Nov 05 03:43:35 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:35 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD
Nov 05 03:43:35 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:35 devstack sudo[91772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD
Nov 05 03:43:35 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:35 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:35 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1880435055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de370899-1748-4bcd-b9fc-7a08b9096b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18858cb9390b49c6be0d1b1a916f2706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:32Z,use_quota=True,user_id='9eb50ddece434058aff4f63ca34110f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Creating volume de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:35 devstack sudo[91783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:35 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:35 devstack sudo[91785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 1073741824
Nov 05 03:43:35 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:35 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:35 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5c127144-6a1d-4552-b511-a640b9e07875" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Lock "cinder-quobyte-5c127144-6a1d-4552-b511-a640b9e07875" released by "delete_volume" :: held 0.953s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Created reservations ['1e5d9608-d588-4548-a4f4-81aff90a3fc7', 'e653bccd-25f6-4d03-b1cf-82610930c265', '60579af8-3f64-4855-b7a7-bc5de9aef4e3', 'e0f77e43-8026-496b-b91b-21f4644c104c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:36 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:36 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:36 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 1073741824" returned: 0 in 0.654s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:36 devstack sudo[91800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57
Nov 05 03:43:36 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:36 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Deleted volume successfully.
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21e6fd2f-85e1-43e7-9c0e-3ea1f3968bcc tempest-VolumesTestJSON-1320271578 None] Lock "cinder-5c127144-6a1d-4552-b511-a640b9e07875-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:36 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1534809941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06bf5a9-3049-4a27-9280-4e08dc10d465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0210d97d27349f0bd4e377f0e1c4efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:33Z,use_quota=True,user_id='0ca6c4b242bc44dcbaeb600d5928f11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Creating volume c06bf5a9-3049-4a27-9280-4e08dc10d465 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:36 devstack sudo[91803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 1073741824
Nov 05 03:43:36 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Attempting download of b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume de370899-1748-4bcd-b9fc-7a08b9096b57. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609d371-dede-4b3d-b66d-a41df929de8e]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:36 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9
Nov 05 03:43:36 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:37 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 1073741824" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:37 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:37 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465
Nov 05 03:43:37 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:37 devstack sudo[91814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9
Nov 05 03:43:37 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:37 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Attempting download of b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume c06bf5a9-3049-4a27-9280-4e08dc10d465. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32777e2-ede7-49c9-be6f-ce759f2f6a6b]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:37 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9" returned: 1 in 0.449s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_vusfihl9' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1700d-45ec-4220-9020-7979b64fc43c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:37 devstack sudo[91820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f
Nov 05 03:43:37 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:37 devstack sudo[91821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD
Nov 05 03:43:37 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:38 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:38 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] b168d99d-9565-4249-9e41-af4fab9708fb was qcow2, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:38 devstack sudo[91830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57
Nov 05 03:43:38 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:38 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f
Nov 05 03:43:38 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:38 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f" returned: 1 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_qt958_8f' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaaa701-7b50-4573-ba95-a1fe2be67bd0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:38 devstack sudo[91838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD
Nov 05 03:43:38 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:39 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:39 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] b168d99d-9565-4249-9e41-af4fab9708fb was qcow2, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:43:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:39 devstack sudo[91847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465
Nov 05 03:43:39 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:40 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57" returned: 0 in 2.661s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:40 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_wbpo6afkdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:43:40 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Converted 112.00 MB image at 42.06 MB/s
Nov 05 03:43:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:41 devstack sudo[91854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 1G
Nov 05 03:43:41 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:41 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 1G" returned: 0 in 0.597s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Downloaded image b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume de370899-1748-4bcd-b9fc-7a08b9096b57 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb for user 9eb50ddece434058aff4f63ca34110f6 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Marking volume de370899-1748-4bcd-b9fc-7a08b9096b57 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Copying metadata from image b168d99d-9565-4249-9e41-af4fab9708fb to de370899-1748-4bcd-b9fc-7a08b9096b57. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Creating volume glance metadata for volume de370899-1748-4bcd-b9fc-7a08b9096b57 backed by image b168d99d-9565-4249-9e41-af4fab9708fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06629f3-2550-4aeb-b074-ee0fcff00dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de370899-1748-4bcd-b9fc-7a08b9096b57', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7351f2090>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bcefd6-73da-469e-b2e6-5df1bc3de39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Volume volume-de370899-1748-4bcd-b9fc-7a08b9096b57 (de370899-1748-4bcd-b9fc-7a08b9096b57): created successfully
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bcefd6-73da-469e-b2e6-5df1bc3de39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Flow 'volume_create_manager' (3f6af48b-b299-4f3c-a5e1-d218b80928f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-79d4fe61-6f85-4b3d-96da-cac9ae8eb438 tempest-VolumesExtendTest-1887552187 None] Created volume successfully.
Nov 05 03:43:41 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465" returned: 0 in 2.828s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_vnkzym7ddevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:43:41 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Converted 112.00 MB image at 39.59 MB/s
Nov 05 03:43:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:42 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 1G
Nov 05 03:43:42 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[717440b6-7b1d-44c9-87a5-4dccd20c8d54]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:42 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 1G" returned: 0 in 0.532s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Downloaded image b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume c06bf5a9-3049-4a27-9280-4e08dc10d465 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb for user 0ca6c4b242bc44dcbaeb600d5928f11e is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Marking volume c06bf5a9-3049-4a27-9280-4e08dc10d465 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Copying metadata from image b168d99d-9565-4249-9e41-af4fab9708fb to c06bf5a9-3049-4a27-9280-4e08dc10d465. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Creating volume glance metadata for volume c06bf5a9-3049-4a27-9280-4e08dc10d465 backed by image b168d99d-9565-4249-9e41-af4fab9708fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:43:42 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57
Nov 05 03:43:42 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e9acba-03c1-4c64-9274-9d91cccf3294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06bf5a9-3049-4a27-9280-4e08dc10d465', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7350c2bd0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fea248-a5db-4571-b042-cd9270b8b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:42 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Volume volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 (c06bf5a9-3049-4a27-9280-4e08dc10d465): created successfully
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fea248-a5db-4571-b042-cd9270b8b068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Flow 'volume_create_manager' (22a65b5a-c9da-4d97-907a-096375c5838d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cc9b5233-5352-4b2f-80cb-c1adce47ecb2 tempest-ServerActionsTestOtherA-813450021 None] Created volume successfully.
Nov 05 03:43:42 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57" returned: 0 in 0.502s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 2G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 2G" returned: 0 in 0.108s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.649s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-51844aac-e40b-4698-be7b-9f142939a4d0 tempest-VolumesExtendTest-1887552187 None] Extend volume completed successfully.
Nov 05 03:43:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a687de6-e102-4aee-bb27-c89349216d2a tempest-BackendsCapabilitiesAdminTestsJSON-1349817571 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5548400878906, 'free_capacity_gb': 1773.5548400878906, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}}
Nov 05 03:43:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9590e13c-40ca-4a8e-8ca8-32b123fc8ca3 tempest-BackendsCapabilitiesAdminTestsJSON-1349817571 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5548400878906, 'free_capacity_gb': 1773.5548400878906, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-de370899-1748-4bcd-b9fc-7a08b9096b57-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Lock "cinder-de370899-1748-4bcd-b9fc-7a08b9096b57-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-quobyte-de370899-1748-4bcd-b9fc-7a08b9096b57" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-de370899-1748-4bcd-b9fc-7a08b9096b57" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae3b2c9-02cc-458f-a322-0b9526c0624e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:44 devstack sudo[91895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57
Nov 05 03:43:44 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:44 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57" returned: 0 in 0.533s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:44 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57
Nov 05 03:43:44 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:45 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de370899-1748-4bcd-b9fc-7a08b9096b57" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-de370899-1748-4bcd-b9fc-7a08b9096b57" released by "delete_volume" :: held 0.911s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Created reservations ['01661902-30c2-407b-bcb6-415fa1c977ac', 'becda49c-6eb9-46e7-b985-fdc4e7f9b9fe', '74ec2f1f-4e7a-4145-9979-5d577eb304ae', '961447eb-bd9f-4742-8af8-7e92e02c7f2e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:45 devstack sudo[91907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:43:45 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:45 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:43:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Deleted volume successfully.
Nov 05 03:43:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c72b1bd3-ce47-4f7d-91cd-051d05449138 tempest-VolumesExtendTest-1887552187 None] Lock "cinder-de370899-1748-4bcd-b9fc-7a08b9096b57-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Flow 'volume_create_manager' (82d08f34-d8e9-42a4-b114-3698f925f4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e229b5-8726-4bf6-81d3-b3b160af8999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e229b5-8726-4bf6-81d3-b3b160af8999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-572952686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d63c2a-8523-4c1b-b657-ccb9b56a8f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18858cb9390b49c6be0d1b1a916f2706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:46Z,use_quota=True,user_id='9eb50ddece434058aff4f63ca34110f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dfa4c6-4085-4f3e-affe-9ed1e8a585eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dfa4c6-4085-4f3e-affe-9ed1e8a585eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5c261c-90f7-4789-b676-01aff4c9bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5c261c-90f7-4789-b676-01aff4c9bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d63c2a-8523-4c1b-b657-ccb9b56a8f16', 'volume_name': 'volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cffcc1-7376-43d2-953f-867b501f435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cffcc1-7376-43d2-953f-867b501f435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515e029-e115-4f34-a978-b119ea101868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Volume 18d63c2a-8523-4c1b-b657-ccb9b56a8f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16', 'volume_size': 1}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-572952686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d63c2a-8523-4c1b-b657-ccb9b56a8f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18858cb9390b49c6be0d1b1a916f2706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:46Z,use_quota=True,user_id='9eb50ddece434058aff4f63ca34110f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Creating volume 18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:46 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:46 devstack sudo[91913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 1073741824
Nov 05 03:43:46 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2c93baa1-a41b-4bf7-8708-146661876a7c req-49102be9-7bf7-4a1c-be9c-7aa7362f534b tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:46 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 1073741824" returned: 0 in 0.735s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:47 devstack sudo[91961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16
Nov 05 03:43:47 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:47 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" returned: 0 in 0.447s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2c93baa1-a41b-4bf7-8708-146661876a7c req-49102be9-7bf7-4a1c-be9c-7aa7362f534b tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.555s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2c93baa1-a41b-4bf7-8708-146661876a7c req-49102be9-7bf7-4a1c-be9c-7aa7362f534b tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515e029-e115-4f34-a978-b119ea101868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271ee86c-0544-42fe-abe6-299aef9b3563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Volume volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 (18d63c2a-8523-4c1b-b657-ccb9b56a8f16): created successfully
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271ee86c-0544-42fe-abe6-299aef9b3563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Flow 'volume_create_manager' (82d08f34-d8e9-42a4-b114-3698f925f4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-2c93baa1-a41b-4bf7-8708-146661876a7c req-49102be9-7bf7-4a1c-be9c-7aa7362f534b tempest-ServerActionsTestOtherA-813450021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-c06bf5a9-3049-4a27-9280-4e08dc10d465', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36d1b345-6c87-4ddb-95d2-d767d945c75a', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:43:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3a02b177-75a7-47e9-9aeb-859af3930130 tempest-VolumesExtendTest-1887552187 None] Created volume successfully.
Nov 05 03:43:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-2c93baa1-a41b-4bf7-8708-146661876a7c req-49102be9-7bf7-4a1c-be9c-7aa7362f534b tempest-ServerActionsTestOtherA-813450021 None] attachment_update completed successfully.
Nov 05 03:43:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Creating offline snapshot c9675147-7313-4fbc-8da6-d97e73c8e4c6 of volume 18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:43:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a02bed-c4e4-4238-b9ec-7a78e0674815]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:48 devstack sudo[91966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16
Nov 05 03:43:48 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:49 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:49 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 1G
Nov 05 03:43:49 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:49 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 1G" returned: 0 in 0.641s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:49 devstack sudo[91981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6
Nov 05 03:43:49 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:50 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:50 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 is being set with open permissions: ugo+rw
Nov 05 03:43:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:50 devstack sudo[91986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6
Nov 05 03:43:50 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:50 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:50 devstack sudo[92089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info
Nov 05 03:43:50 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:51 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info" returned: 0 in 0.568s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info is being set with open permissions: ugo+rw
Nov 05 03:43:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:51 devstack sudo[92131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info
Nov 05 03:43:51 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:51 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.info" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.346s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-79d70b74-f050-4034-b1f1-e56c2d8b30b4 tempest-VolumesExtendTest-1887552187 None] Create snapshot completed successfully
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ca425-0c0e-4581-ab51-097bfb14d3b6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:53 devstack sudo[92450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16
Nov 05 03:43:53 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9f91e147-a179-482a-956c-3d9d6e08a919 tempest-GroupSnapshotsTest-793217181 None] Group tempest-GroupSnapshotsTest-Group-2016091400: creating
Nov 05 03:43:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9f91e147-a179-482a-956c-3d9d6e08a919 tempest-GroupSnapshotsTest-793217181 None] Group tempest-GroupSnapshotsTest-Group-2016091400: created successfully
Nov 05 03:43:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9f91e147-a179-482a-956c-3d9d6e08a919 tempest-GroupSnapshotsTest-793217181 None] Create group completed successfully.
Nov 05 03:43:53 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 2G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 2G" returned: 0 in 0.156s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.677s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0d31f1ae-efec-42b1-8c1d-80edf428e40d tempest-VolumesExtendTest-1887552187 None] Extend volume completed successfully.
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-c9675147-7313-4fbc-8da6-d97e73c8e4c6-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Lock "cinder-c9675147-7313-4fbc-8da6-d97e73c8e4c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-quobyte-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-quobyte-c9675147-7313-4fbc-8da6-d97e73c8e4c6" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-c9675147-7313-4fbc-8da6-d97e73c8e4c6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Deleting offline snapshot c9675147-7313-4fbc-8da6-d97e73c8e4c6 of volume 18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] snapshot_file for this snap is: volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5c05d-fadd-40ea-a408-b19fb8390183]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:54 devstack sudo[92462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6
Nov 05 03:43:54 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:55 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6" returned: 0 in 0.894s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:43:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[45720960-3786-4f0e-8799-b8c1f521e674]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:55 devstack sudo[92467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16
Nov 05 03:43:55 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Flow 'volume_create_manager' (99ef1c51-923b-49ae-8da8-3bfc11598289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf69885-b866-4163-9799-f258fe250e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (219d751e-e67e-4b3a-a860-cacd33beb780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174c6661-2e14-4adb-899d-59b90f7d8969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf69885-b866-4163-9799-f258fe250e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-977544250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24e2446-e377-44a5-840d-36cfe49b8475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdf2eb95df540198bed0602de9d2993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:56Z,use_quota=True,user_id='83bb7ba109fa44da9ec66b1f8f66471d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3c54e6-4c62-4650-bbc3-2b2cd8135d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3c54e6-4c62-4650-bbc3-2b2cd8135d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c0bc32-3a4d-4a69-aa99-5bfb644a2355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c0bc32-3a4d-4a69-aa99-5bfb644a2355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24e2446-e377-44a5-840d-36cfe49b8475', 'volume_name': 'volume-d24e2446-e377-44a5-840d-36cfe49b8475', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51672f68-1ba4-4c9c-aef7-83c1131e0363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51672f68-1ba4-4c9c-aef7-83c1131e0363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c6d2fd-4830-46a7-a552-daa82a8b8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Volume d24e2446-e377-44a5-840d-36cfe49b8475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24e2446-e377-44a5-840d-36cfe49b8475', 'volume_size': 1}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-977544250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24e2446-e377-44a5-840d-36cfe49b8475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdf2eb95df540198bed0602de9d2993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:56Z,use_quota=True,user_id='83bb7ba109fa44da9ec66b1f8f66471d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Creating volume d24e2446-e377-44a5-840d-36cfe49b8475 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" returned: 0 in 0.808s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:56 devstack sudo[92476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475 1073741824
Nov 05 03:43:56 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174c6661-2e14-4adb-899d-59b90f7d8969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238126309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a51e5736-ebe7-427e-b5b5-2bc2866d6a2d,host='devstack@QuobyteHD#QuobyteHD',id=38a4eccb-6bfd-4a48-9c94-ec43dd5be45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:56Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cdee9af-3f67-49dd-ba2c-473bbbf2e8de),volume_type_id=0cdee9af-3f67-49dd-ba2c-473bbbf2e8de)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bce1627-974a-431e-bd62-2c30513ab2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bce1627-974a-431e-bd62-2c30513ab2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca59b626-a370-4ac7-b738-1c6aa063d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack sudo[92477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca59b626-a370-4ac7-b738-1c6aa063d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a4eccb-6bfd-4a48-9c94-ec43dd5be45e', 'volume_name': 'volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310101a0-850d-4766-9c24-8c361cc83fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310101a0-850d-4766-9c24-8c361cc83fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442c9014-a7a3-4ece-9d2b-f0ba8e711136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Volume 38a4eccb-6bfd-4a48-9c94-ec43dd5be45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e', 'volume_size': 1}
Nov 05 03:43:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:57 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6" returned: 0 in 0.797s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:57 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475 1073741824" returned: 0 in 0.838s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:57 devstack sudo[92489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6
Nov 05 03:43:57 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:57 devstack sudo[92492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475
Nov 05 03:43:57 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:57 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16.c9675147-7313-4fbc-8da6-d97e73c8e4c6" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-c9675147-7313-4fbc-8da6-d97e73c8e4c6" released by "_delete_snapshot" :: held 3.110s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" released by "delete_snapshot" :: held 3.156s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Created reservations ['4231ef0f-f85e-4b0c-85fb-05969b1d1e29', 'a0ed4577-fa01-4baf-80c8-4e3739d05ced', '8570d259-5c33-46cb-adc9-e875d17a16a5', 'a34d8f61-223f-47b0-944a-a4531eeb2fcb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:43:57 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a51e5736-ebe7-427e-b5b5-2bc2866d6a2d,created_at=2026-11-05T02:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238126309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a51e5736-ebe7-427e-b5b5-2bc2866d6a2d,host='devstack@QuobyteHD#QuobyteHD',id=38a4eccb-6bfd-4a48-9c94-ec43dd5be45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:56Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cdee9af-3f67-49dd-ba2c-473bbbf2e8de),volume_type_id=0cdee9af-3f67-49dd-ba2c-473bbbf2e8de)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Creating volume 38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:43:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c6d2fd-4830-46a7-a552-daa82a8b8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24e2446-e377-44a5-840d-36cfe49b8475', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:57 devstack sudo[92498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e 1073741824
Nov 05 03:43:57 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ba393-243c-490a-890c-1e5363adea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Volume volume-d24e2446-e377-44a5-840d-36cfe49b8475 (d24e2446-e377-44a5-840d-36cfe49b8475): created successfully
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ba393-243c-490a-890c-1e5363adea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Flow 'volume_create_manager' (99ef1c51-923b-49ae-8da8-3bfc11598289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6dbe9119-129e-4bd0-8302-a2511a8e18d7 tempest-AttachVolumeShelveTestJSON-531543952 None] Created volume successfully.
Nov 05 03:43:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Delete snapshot completed successfully.
Nov 05 03:43:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cfef68c-1d72-41a9-8781-b8ab5d6a21bb tempest-VolumesExtendTest-1887552187 None] Lock "cinder-c9675147-7313-4fbc-8da6-d97e73c8e4c6-delete_snapshot" released by "delete_snapshot" :: held 3.563s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:43:58 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e 1073741824" returned: 0 in 0.737s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:58 devstack sudo[92504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e
Nov 05 03:43:58 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-18d63c2a-8523-4c1b-b657-ccb9b56a8f16-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Lock "cinder-18d63c2a-8523-4c1b-b657-ccb9b56a8f16-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Acquiring lock "cinder-quobyte-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:43:59 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" returned: 0 in 0.829s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442c9014-a7a3-4ece-9d2b-f0ba8e711136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516c2f93-8fa2-482f-a92b-6bf8d43bdb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7381eb8e-0190-418f-889c-5fe5f01f86b4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:43:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Volume volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e (38a4eccb-6bfd-4a48-9c94-ec43dd5be45e): created successfully
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516c2f93-8fa2-482f-a92b-6bf8d43bdb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:43:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (219d751e-e67e-4b3a-a860-cacd33beb780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:43:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fc82b6f2-d581-4250-b244-845d6b4e0dae tempest-GroupSnapshotsTest-793217181 None] Created volume successfully.
Nov 05 03:43:59 devstack sudo[92512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16
Nov 05 03:43:59 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:00 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" returned: 0 in 0.719s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:00 devstack sudo[92518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16
Nov 05 03:44:00 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:00 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" returned: 0 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Lock "cinder-quobyte-18d63c2a-8523-4c1b-b657-ccb9b56a8f16" released by "delete_volume" :: held 1.367s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Created reservations ['97938e95-bad1-46c6-900c-c9d017275b52', 'c381c87e-d595-40dc-b52c-ed04100214cd', '91770db9-ab80-43a5-987f-49441e315482', '93b5134b-300c-4f16-9167-2486e284592c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:01 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:01 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:01 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Deleted volume successfully.
Nov 05 03:44:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] GroupSnapshot 758f984c-9c16-46ab-aa43-8caf4af1fcf8: creating.
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5311352-aae1-49d1-a4b0-c11c7c50b21c tempest-VolumesExtendTest-1887552187 None] Lock "cinder-18d63c2a-8523-4c1b-b657-ccb9b56a8f16-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Group snapshot 758f984c-9c16-46ab-aa43-8caf4af1fcf8: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Creating offline snapshot 3e4fc680-7a07-4667-8e34-c0dd4017d483 of volume 38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa43c07d-0d3a-4b36-9a20-ff98281717a8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:02 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e
Nov 05 03:44:02 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:02 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" returned: 0 in 0.885s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:02 devstack sudo[92543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 1G
Nov 05 03:44:02 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:03 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 1G" returned: 0 in 1.185s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:04 devstack sudo[92561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483
Nov 05 03:44:04 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:04 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483" returned: 0 in 0.743s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:04 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:04 devstack sudo[92566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483
Nov 05 03:44:04 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:05 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483" returned: 0 in 0.638s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:05 devstack sudo[92569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info
Nov 05 03:44:05 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:05 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:05 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:05 devstack sudo[92573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info
Nov 05 03:44:05 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:06 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.info" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ae2404be-dcde-4af9-9b5b-fc5eeda5d96b tempest-GroupSnapshotsTest-793217181 None] group_snapshot 758f984c-9c16-46ab-aa43-8caf4af1fcf8: created successfully
Nov 05 03:44:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-60e5af15-8415-4721-be06-ff9209f21a97 tempest-ServerActionsTestOtherA-813450021 None] Terminate volume connection completed successfully.
Nov 05 03:44:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-60e5af15-8415-4721-be06-ff9209f21a97 tempest-ServerActionsTestOtherA-813450021 None] Deleting attachment 36d1b345-6c87-4ddb-95d2-d767d945c75a. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:08 devstack sudo[92634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:08 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-3e4fc680-7a07-4667-8e34-c0dd4017d483-715f4940-fe78-4b0f-baf4-dff19e10cf89" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-3e4fc680-7a07-4667-8e34-c0dd4017d483-715f4940-fe78-4b0f-baf4-dff19e10cf89" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Creating volume 715f4940-fe78-4b0f-baf4-dff19e10cf89 from snapshot 3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-715f4940-fe78-4b0f-baf4-dff19e10cf89" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-715f4940-fe78-4b0f-baf4-dff19e10cf89" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] snapshot: 3e4fc680-7a07-4667-8e34-c0dd4017d483, volume: 715f4940-fe78-4b0f-baf4-dff19e10cf89,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-01776581-78c0-4084-8eca-1a71eea8ad6e tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db087f2-20c7-4e8c-8b7a-b5609d7b6fec]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:09 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:44:09 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483
Nov 05 03:44:09 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Flow 'volume_create_manager' (53a44698-2aca-4d82-beef-0d18d0a554b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeacc277-e855-43b6-b179-88fc09bed753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeacc277-e855-43b6-b179-88fc09bed753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-200654251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ff4e2b-aa05-479e-b170-6f67fdbf830d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='166f38233293452da120f1369ba1f384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:10Z,use_quota=True,user_id='12b3c678fe954252aef9462d6e1f92f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340896cc-75da-418c-b413-1fb85bb8b243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340896cc-75da-418c-b413-1fb85bb8b243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f003b0-8155-4ea7-9646-8d0b1eeba348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f003b0-8155-4ea7-9646-8d0b1eeba348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ff4e2b-aa05-479e-b170-6f67fdbf830d', 'volume_name': 'volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:09 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf47f2d-4f1f-4bd8-9c8a-bd80385e1e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf47f2d-4f1f-4bd8-9c8a-bd80385e1e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a64ae35-6f9d-4cb5-bba2-b229e465e2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Volume c0ff4e2b-aa05-479e-b170-6f67fdbf830d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d', 'volume_size': 1}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483" returned: 0 in 0.580s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e56e0a-3106-4320-9f72-cef8328e0151]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:09 devstack sudo[92645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e
Nov 05 03:44:09 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:10 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:44:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:44:10 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:44:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:10 devstack sudo[92650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89
Nov 05 03:44:10 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-21aaa452-6332-43a9-bb70-f25cf2945022 req-771c1dab-d917-4033-8fea-cba81e00b91e tempest-AttachVolumeShelveTestJSON-531543952 None] No connector for attachment 825491c1-7eaf-4144-b16f-070a7a8348f6; skipping storage backend terminate_connection call. {{(pid=87098) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5031}}
Nov 05 03:44:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-21aaa452-6332-43a9-bb70-f25cf2945022 req-771c1dab-d917-4033-8fea-cba81e00b91e tempest-AttachVolumeShelveTestJSON-531543952 None] Deleting attachment 825491c1-7eaf-4144-b16f-070a7a8348f6. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:44:18 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89" returned: 0 in 8.546s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:18 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:44:18 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Converted 1024.00 MB image at 119.80 MB/s
Nov 05 03:44:18 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:18 devstack sudo[92699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89
Nov 05 03:44:18 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:19 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-715f4940-fe78-4b0f-baf4-dff19e10cf89" released by "_copy_volume_from_snapshot" :: held 10.075s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-3e4fc680-7a07-4667-8e34-c0dd4017d483-715f4940-fe78-4b0f-baf4-dff19e10cf89" released by "_create_volume_from_snapshot" :: held 10.192s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.241s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-01776581-78c0-4084-8eca-1a71eea8ad6e tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.120s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-01776581-78c0-4084-8eca-1a71eea8ad6e tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.465s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-200654251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ff4e2b-aa05-479e-b170-6f67fdbf830d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='166f38233293452da120f1369ba1f384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:10Z,use_quota=True,user_id='12b3c678fe954252aef9462d6e1f92f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Creating volume c0ff4e2b-aa05-479e-b170-6f67fdbf830d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:19 devstack sudo[92703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d 1073741824
Nov 05 03:44:19 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-01776581-78c0-4084-8eca-1a71eea8ad6e tempest-ServerActionsTestOtherA-813450021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-c06bf5a9-3049-4a27-9280-4e08dc10d465', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c479d63f-0a76-4b14-a932-1b82a1e1da1e', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:44:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d2fdccad-abb6-4a1f-8ddb-1c4104033034 tempest-GroupSnapshotsTest-793217181 None] Create group from source-snapshot-758f984c-9c16-46ab-aa43-8caf4af1fcf8 completed successfully.
Nov 05 03:44:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5803cc6c-3f26-4e8a-9a5f-ed623d948bcb req-01776581-78c0-4084-8eca-1a71eea8ad6e tempest-ServerActionsTestOtherA-813450021 None] attachment_update completed successfully.
Nov 05 03:44:19 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d 1073741824" returned: 0 in 0.670s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=113,cinder:INSERT=30,cinder:UPDATE=99,cinder:DELETE=7 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=100,cinder:SELECT=108,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:44:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:19 devstack sudo[92783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d
Nov 05 03:44:19 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:20 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a64ae35-6f9d-4cb5-bba2-b229e465e2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bb9101-bc8b-4671-905b-3c340a3b06b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Volume volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d (c0ff4e2b-aa05-479e-b170-6f67fdbf830d): created successfully
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bb9101-bc8b-4671-905b-3c340a3b06b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Flow 'volume_create_manager' (53a44698-2aca-4d82-beef-0d18d0a554b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3ad631a1-a3af-466a-9c27-77d567982ee3 tempest-VolumesListTestJSON-1699557797 None] Created volume successfully.
Nov 05 03:44:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-715f4940-fe78-4b0f-baf4-dff19e10cf89" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-715f4940-fe78-4b0f-baf4-dff19e10cf89" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f6997-3cba-4506-a85e-1d4a639b52d9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:21 devstack sudo[93166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89
Nov 05 03:44:21 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:22 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89" returned: 0 in 0.771s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:22 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89
Nov 05 03:44:22 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:22 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-715f4940-fe78-4b0f-baf4-dff19e10cf89" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-715f4940-fe78-4b0f-baf4-dff19e10cf89" released by "delete_volume" :: held 1.331s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['fdbaa59c-48bb-4792-a0ec-1e053084ee7f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Flow 'volume_create_manager' (29aced49-bd85-4b84-b609-bfde317899b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7aea2c-eb2a-4efa-b02f-5fb3f4d28c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7aea2c-eb2a-4efa-b02f-5fb3f4d28c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1586415064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='166f38233293452da120f1369ba1f384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:23Z,use_quota=True,user_id='12b3c678fe954252aef9462d6e1f92f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a442bef8-2214-424c-b4f8-5fa374cb65e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a442bef8-2214-424c-b4f8-5fa374cb65e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508c7adf-0c3e-45bd-9e4f-1da4e1e00d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508c7adf-0c3e-45bd-9e4f-1da4e1e00d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb', 'volume_name': 'volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05586c7-d8ee-48df-9cfc-574fc065cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05586c7-d8ee-48df-9cfc-574fc065cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e78bc9-19e9-496e-915f-dc790c17705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Volume 6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb', 'volume_size': 1}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1586415064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='166f38233293452da120f1369ba1f384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:23Z,use_quota=True,user_id='12b3c678fe954252aef9462d6e1f92f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Creating volume 6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:23 devstack cinder-volume[87098]: WARNING cinder.quota [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-974258374 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-974258374, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:44:23 devstack cinder-volume[87098]: WARNING cinder.quota [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-974258374 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-974258374, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:44:23 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb 1073741824
Nov 05 03:44:23 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['d2a4f804-ed23-4ed7-81f9-55de0b90f3eb', '92e15495-7f88-4e75-8069-079f82883448', 'a93953f5-33f3-41ba-bb2a-390bd29fcaa6', '850a4181-b66d-4e21-b86b-729a864817eb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:23 devstack sudo[93180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:23 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:24 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-79ea6985-44ff-45d9-b22b-13bf9b61ade0 tempest-GroupSnapshotsTest-793217181 None] Delete group completed successfully.
Nov 05 03:44:24 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb 1073741824" returned: 0 in 1.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 758f984c-9c16-46ab-aa43-8caf4af1fcf8: deleting
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 758f984c-9c16-46ab-aa43-8caf4af1fcf8: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:24 devstack sudo[93186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb
Nov 05 03:44:24 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-3e4fc680-7a07-4667-8e34-c0dd4017d483" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-3e4fc680-7a07-4667-8e34-c0dd4017d483" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Deleting offline snapshot 3e4fc680-7a07-4667-8e34-c0dd4017d483 of volume 38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] snapshot_file for this snap is: volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[51659091-e198-4b01-9665-f9c671387589]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:25 devstack sudo[93188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483
Nov 05 03:44:25 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:25 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb" returned: 0 in 0.793s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e78bc9-19e9-496e-915f-dc790c17705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c112d41-0ed0-466e-a080-e54347e71c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Volume volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb (6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb): created successfully
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c112d41-0ed0-466e-a080-e54347e71c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Flow 'volume_create_manager' (29aced49-bd85-4b84-b609-bfde317899b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-884bf7a5-269c-4a6e-bb25-d113c3cea171 tempest-VolumesListTestJSON-1699557797 None] Created volume successfully.
Nov 05 03:44:25 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483" returned: 0 in 1.001s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f010b3f-b615-4ddd-97df-d621f91dc7d6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:26 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e
Nov 05 03:44:26 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:26 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" returned: 0 in 0.941s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:26 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483
Nov 05 03:44:26 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:27 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Flow 'volume_create_manager' (703f59a0-821f-4f83-9841-b733852a0698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa14611-fbeb-4b02-8cef-32740e167299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483" returned: 0 in 0.854s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa14611-fbeb-4b02-8cef-32740e167299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-274487818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522c6d08-e834-4a5a-85ee-53bbc2a929c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='166f38233293452da120f1369ba1f384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:28Z,use_quota=True,user_id='12b3c678fe954252aef9462d6e1f92f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d27094-dca1-4822-82fc-9f436c932c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:27 devstack sudo[93226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483
Nov 05 03:44:27 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d27094-dca1-4822-82fc-9f436c932c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19606ae-c974-4f91-b030-23154cba5815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19606ae-c974-4f91-b030-23154cba5815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522c6d08-e834-4a5a-85ee-53bbc2a929c6', 'volume_name': 'volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b596e434-218c-4b9a-99c5-fd472bf8021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b596e434-218c-4b9a-99c5-fd472bf8021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6660d51-9dfe-4abc-bd74-f80159c8a2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Volume 522c6d08-e834-4a5a-85ee-53bbc2a929c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6', 'volume_size': 1}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-274487818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522c6d08-e834-4a5a-85ee-53bbc2a929c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='166f38233293452da120f1369ba1f384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:28Z,use_quota=True,user_id='12b3c678fe954252aef9462d6e1f92f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Creating volume 522c6d08-e834-4a5a-85ee-53bbc2a929c6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:44:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:27 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 1073741824
Nov 05 03:44:27 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:28 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e.3e4fc680-7a07-4667-8e34-c0dd4017d483" returned: 0 in 0.581s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-3e4fc680-7a07-4667-8e34-c0dd4017d483" released by "_delete_snapshot" :: held 3.687s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" released by "delete_snapshot" :: held 3.748s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:28 devstack cinder-volume[87098]: WARNING cinder.quota [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-974258374 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-974258374, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:44:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['27f9ca94-626f-431a-8ae7-699189c34162', '55db0438-aaba-470a-826a-4366e97e6113', '9c2a5e3f-3c9e-4a0f-8a14-21edb69a3464', 'ed91ad48-e2f6-479e-937b-cfbac5bc1ab2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:28 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 1073741824" returned: 0 in 0.976s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-deca2759-d784-4a5c-982d-9af97b147103 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 758f984c-9c16-46ab-aa43-8caf4af1fcf8: deleted successfully
Nov 05 03:44:29 devstack sudo[93246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6
Nov 05 03:44:29 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:29 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6660d51-9dfe-4abc-bd74-f80159c8a2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b47703-a23e-46d7-aa44-f4d4ff912d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Volume volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 (522c6d08-e834-4a5a-85ee-53bbc2a929c6): created successfully
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b47703-a23e-46d7-aa44-f4d4ff912d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Flow 'volume_create_manager' (703f59a0-821f-4f83-9841-b733852a0698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e64c5a5e-9573-4667-9b18-0ef22884a140 tempest-VolumesListTestJSON-1699557797 None] Created volume successfully.
Nov 05 03:44:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" acquired by "delete_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eeea59-3a03-4f09-ac7b-2646cb81c5ff]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:30 devstack sudo[93258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e
Nov 05 03:44:30 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:31 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" returned: 0 in 0.824s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:31 devstack sudo[93263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e
Nov 05 03:44:31 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:32 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" returned: 0 in 0.626s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-38a4eccb-6bfd-4a48-9c94-ec43dd5be45e" released by "delete_volume" :: held 1.655s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Created reservations ['575c76c7-abd3-41c3-a13d-34c236d24d95'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:32 devstack cinder-volume[87098]: WARNING cinder.db.api [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-974258374']
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Created reservations ['c62d7a06-194a-4439-a970-6b9100984e4c', 'e935bc56-60e9-4c3f-946e-a85c379d5ce8', '486b7bc2-f716-4ff0-9f19-2e970ce08fea', 'a16db909-47df-4599-899e-0f89b22f3570'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:32 devstack sudo[93267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:32 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:33 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.555s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:33 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4dfba5e2-5dd7-435d-8ce3-bfa77f28b9ff tempest-GroupSnapshotsTest-793217181 None] Delete group completed successfully.
Nov 05 03:44:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-afea4506-97a4-4160-bac7-ec71fd2a1b29 tempest-GroupSnapshotsTest-793217181 None] Group tempest-GroupSnapshotsTest-Group-1398885447: creating
Nov 05 03:44:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-afea4506-97a4-4160-bac7-ec71fd2a1b29 tempest-GroupSnapshotsTest-793217181 None] Group tempest-GroupSnapshotsTest-Group-1398885447: created successfully
Nov 05 03:44:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-afea4506-97a4-4160-bac7-ec71fd2a1b29 tempest-GroupSnapshotsTest-793217181 None] Create group completed successfully.
Nov 05 03:44:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "cinder-522c6d08-e834-4a5a-85ee-53bbc2a929c6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-522c6d08-e834-4a5a-85ee-53bbc2a929c6-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "cinder-quobyte-522c6d08-e834-4a5a-85ee-53bbc2a929c6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-quobyte-522c6d08-e834-4a5a-85ee-53bbc2a929c6" acquired by "delete_volume" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4ef38c-de46-4655-adbd-c4fe11affbac]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:36 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6
Nov 05 03:44:36 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:36 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6" returned: 0 in 0.632s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:36 devstack sudo[93348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6
Nov 05 03:44:36 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (73f1a8da-28a6-4fd7-b229-1b053c7f027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661738f2-a143-451e-95b0-a6d9458a9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661738f2-a143-451e-95b0-a6d9458a9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-842918480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ca5240d-643b-45e7-b394-2c9bca8b3a6f,host='devstack@QuobyteHD#QuobyteHD',id=4d93ecb2-6e92-4c65-a0b2-90cd300656aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:37Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(808e922d-9245-45bf-a55a-c36232ad3972),volume_type_id=808e922d-9245-45bf-a55a-c36232ad3972)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28754eed-cf69-4be6-87f9-f2eaaab4355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28754eed-cf69-4be6-87f9-f2eaaab4355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:37 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d84522-2238-4bb5-a2b1-d1fb35a8e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d84522-2238-4bb5-a2b1-d1fb35a8e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d93ecb2-6e92-4c65-a0b2-90cd300656aa', 'volume_name': 'volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1abadf7-4688-4ffd-ab55-c7a5530277ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1abadf7-4688-4ffd-ab55-c7a5530277ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aa1d7e-a6bb-4840-9f0d-29f686f903b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Volume 4d93ecb2-6e92-4c65-a0b2-90cd300656aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa', 'volume_size': 1}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1ca5240d-643b-45e7-b394-2c9bca8b3a6f,created_at=2026-11-05T02:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-842918480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ca5240d-643b-45e7-b394-2c9bca8b3a6f,host='devstack@QuobyteHD#QuobyteHD',id=4d93ecb2-6e92-4c65-a0b2-90cd300656aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:37Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(808e922d-9245-45bf-a55a-c36232ad3972),volume_type_id=808e922d-9245-45bf-a55a-c36232ad3972)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Creating volume 4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:37 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-522c6d08-e834-4a5a-85ee-53bbc2a929c6" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-quobyte-522c6d08-e834-4a5a-85ee-53bbc2a929c6" released by "delete_volume" :: held 1.184s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:37 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa 1073741824
Nov 05 03:44:37 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Created reservations ['481ef752-902b-4c9a-ac09-2e0062691c0a', 'a7a7bed1-797f-497c-b648-bacf8a77e905', 'a39c8423-9757-4a1c-922c-7879535e3a33', '2228ac52-7b69-4106-b29e-3058c8ef8566'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:37 devstack sudo[93353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:37 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:37 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Deleted volume successfully.
Nov 05 03:44:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b4efec84-aaa2-4048-89f2-46f458dc1c97 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-522c6d08-e834-4a5a-85ee-53bbc2a929c6-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:38 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa 1073741824" returned: 0 in 0.770s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:38 devstack sudo[93359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa
Nov 05 03:44:38 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "cinder-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:38 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" returned: 0 in 0.428s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aa1d7e-a6bb-4840-9f0d-29f686f903b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54db059-f623-40b6-97dc-06451b6732b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Volume volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa (4d93ecb2-6e92-4c65-a0b2-90cd300656aa): created successfully
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54db059-f623-40b6-97dc-06451b6732b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (73f1a8da-28a6-4fd7-b229-1b053c7f027a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "cinder-quobyte-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-77357698-81c8-4606-9c94-74cb60218b19 tempest-GroupSnapshotsTest-793217181 None] Created volume successfully.
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-quobyte-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdca925-6d35-4824-8e81-3bc46bb3ba31]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:38 devstack sudo[93362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb
Nov 05 03:44:38 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:39 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb" returned: 0 in 0.433s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:39 devstack sudo[93367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb
Nov 05 03:44:39 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:39 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-quobyte-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb" released by "delete_volume" :: held 0.763s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Created reservations ['9f5a46aa-b551-4880-bf64-376df3a6d4db', '8128766d-0d13-468a-b0d2-39c195f5593c', 'f00f336e-ec23-4ab8-8b97-8fecc704768e', 'e0ae0f77-4ce9-44ef-ac6d-c7d707891f1a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:39 devstack sudo[93370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:39 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "cinder-c0ff4e2b-aa05-479e-b170-6f67fdbf830d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-c0ff4e2b-aa05-479e-b170-6f67fdbf830d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "cinder-quobyte-c0ff4e2b-aa05-479e-b170-6f67fdbf830d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-quobyte-c0ff4e2b-aa05-479e-b170-6f67fdbf830d" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c418009c-a36d-480e-9ab2-692e7178b34f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:40 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.534s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Deleted volume successfully.
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61770eb0-157f-4702-aacd-6aabebca4347 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-6f1a4137-cadf-4f11-9b4f-4ed0273b3bdb-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:40 devstack sudo[93396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d
Nov 05 03:44:40 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (b20311bb-9c3b-4d02-8b72-dfe0767dd02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d6d5f9-85d7-4369-be13-d08fd8d60f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d6d5f9-85d7-4369-be13-d08fd8d60f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094176649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ca5240d-643b-45e7-b394-2c9bca8b3a6f,host='devstack@QuobyteHD#QuobyteHD',id=e5f00715-ac9b-4995-b491-77e0e3d9e0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:41Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(808e922d-9245-45bf-a55a-c36232ad3972),volume_type_id=808e922d-9245-45bf-a55a-c36232ad3972)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db505cbd-04fb-479a-9537-fc631a652dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db505cbd-04fb-479a-9537-fc631a652dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa779f4-21b9-441a-ba9c-ea8f104a7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa779f4-21b9-441a-ba9c-ea8f104a7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f00715-ac9b-4995-b491-77e0e3d9e0d9', 'volume_name': 'volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6042df7b-6194-4e43-93ac-efe1e0bdbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6042df7b-6194-4e43-93ac-efe1e0bdbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4bb82f-5fbe-4aae-bdb5-37d9c978c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Volume e5f00715-ac9b-4995-b491-77e0e3d9e0d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9', 'volume_size': 1}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1ca5240d-643b-45e7-b394-2c9bca8b3a6f,created_at=2026-11-05T02:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094176649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ca5240d-643b-45e7-b394-2c9bca8b3a6f,host='devstack@QuobyteHD#QuobyteHD',id=e5f00715-ac9b-4995-b491-77e0e3d9e0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:41Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(808e922d-9245-45bf-a55a-c36232ad3972),volume_type_id=808e922d-9245-45bf-a55a-c36232ad3972)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Creating volume e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:40 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:44:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:41 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d" returned: 0 in 0.869s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:41 devstack sudo[93404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 1073741824
Nov 05 03:44:41 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:41 devstack sudo[93405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d
Nov 05 03:44:41 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:41 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c0ff4e2b-aa05-479e-b170-6f67fdbf830d" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-quobyte-c0ff4e2b-aa05-479e-b170-6f67fdbf830d" released by "delete_volume" :: held 1.341s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Created reservations ['9b56c1c9-b341-4767-bd16-36ba788d84ee', 'b96ddc8c-9ce1-4099-a76b-16192939a511', '0eef992b-b11c-4be0-97a9-40a8689f314c', '1a606a2c-af25-4ff7-9b14-6484740913e8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:41 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:41 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:41 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 1073741824" returned: 0 in 0.711s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:41 devstack sudo[93418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9
Nov 05 03:44:41 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:42 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Deleted volume successfully.
Nov 05 03:44:42 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4bb82f-5fbe-4aae-bdb5-37d9c978c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69991dc-acf8-4099-8c79-158f1ba2c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-60eddb95-5dc7-4b86-8175-f2529bafdfc8 tempest-VolumesListTestJSON-1699557797 None] Lock "cinder-c0ff4e2b-aa05-479e-b170-6f67fdbf830d-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:42 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Volume volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 (e5f00715-ac9b-4995-b491-77e0e3d9e0d9): created successfully
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69991dc-acf8-4099-8c79-158f1ba2c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (b20311bb-9c3b-4d02-8b72-dfe0767dd02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dd7400bf-f082-4df7-a260-f3563b4b92a2 tempest-GroupSnapshotsTest-793217181 None] Created volume successfully.
Nov 05 03:44:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-35b7b025-a863-4c2d-be78-08a55b09caf4 tempest-GroupSnapshotsTest-793217181 None] Update group completed successfully.
Nov 05 03:44:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1b214516-7638-4a13-876c-5e7d8424fe2b tempest-GroupSnapshotsTest-793217181 None] Update group completed successfully.
Nov 05 03:44:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-610f4fc7-27c9-43dd-9fe6-09ff28f5e2ce tempest-GroupSnapshotsTest-793217181 None] Update group completed successfully.
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Flow 'volume_create_manager' (be72c437-d280-4a52-a295-3776ea01f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0118a916-6de5-4ebb-8696-4bc48cc97854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0118a916-6de5-4ebb-8696-4bc48cc97854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-273595595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0efe181093cd4e59b8322ffa775ad7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:47Z,use_quota=True,user_id='3ad82972c77b4e82834f14fca033afa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5915871-1b2a-484e-b9f4-dab1658b2239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5915871-1b2a-484e-b9f4-dab1658b2239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bb0884-4d82-4158-a0ad-15039ba7f400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bb0884-4d82-4158-a0ad-15039ba7f400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7', 'volume_name': 'volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f451af9d-a17e-45b4-b26a-b2c74be86ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f451af9d-a17e-45b4-b26a-b2c74be86ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7150ee92-9266-4dae-82cb-1829592568f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Volume dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7', 'volume_size': 1}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-273595595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0efe181093cd4e59b8322ffa775ad7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:47Z,use_quota=True,user_id='3ad82972c77b4e82834f14fca033afa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Creating volume dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:44:47 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:47 devstack sudo[93429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 1073741824
Nov 05 03:44:47 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:47 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 1073741824" returned: 0 in 0.679s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-137a0a6b-7a78-480f-9eff-9df38cfa6f5b tempest-GroupSnapshotsTest-793217181 None] Update group completed successfully.
Nov 05 03:44:47 devstack sudo[93468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7
Nov 05 03:44:47 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:48 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7150ee92-9266-4dae-82cb-1829592568f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d13e71a-36aa-49a2-8cfd-c7c31ecf5390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:44:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Volume volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 (dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7): created successfully
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d13e71a-36aa-49a2-8cfd-c7c31ecf5390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:44:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Flow 'volume_create_manager' (be72c437-d280-4a52-a295-3776ea01f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:44:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8bcc35ca-402e-4f77-a804-4a3d7a473a8a tempest-VolumesNegativeTest-2035048480 None] Created volume successfully.
Nov 05 03:44:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] GroupSnapshot 3d9b111a-a59d-4ac8-928c-0b5c2087f5b1: creating.
Nov 05 03:44:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Group snapshot 3d9b111a-a59d-4ac8-928c-0b5c2087f5b1: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}}
Nov 05 03:44:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Creating offline snapshot adb5cc3a-9d17-47c9-9824-1d5341824dce of volume e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:44:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[50809851-18f1-40bd-a44a-4b504616b143]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:49 devstack sudo[93474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9
Nov 05 03:44:49 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:50 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" returned: 0 in 0.529s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:50 devstack sudo[93482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce 1G
Nov 05 03:44:50 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:50 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce 1G" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:50 devstack sudo[93488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce
Nov 05 03:44:50 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:51 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:51 devstack sudo[93495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce
Nov 05 03:44:51 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:51 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:51 devstack sudo[93498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info
Nov 05 03:44:51 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:51 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:51 devstack sudo[93501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info
Nov 05 03:44:51 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:52 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.info" returned: 0 in 0.365s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Creating offline snapshot d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 of volume 4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711d197-91d7-4047-96ce-ce812fe43881]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:52 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa
Nov 05 03:44:52 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:53 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" returned: 0 in 0.720s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:53 devstack sudo[93535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 1G
Nov 05 03:44:53 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:53 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 1G" returned: 0 in 0.709s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:53 devstack sudo[93564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6
Nov 05 03:44:53 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:54 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:54 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:54 devstack sudo[93578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6
Nov 05 03:44:54 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:54 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:54 devstack sudo[93581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info
Nov 05 03:44:54 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:54 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:54 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:44:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:54 devstack sudo[93586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info
Nov 05 03:44:54 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:55 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.info" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-806c5ae4-1f8a-4c6f-a326-4e28f9bef78b tempest-GroupSnapshotsTest-793217181 None] group_snapshot 3d9b111a-a59d-4ac8-928c-0b5c2087f5b1: created successfully
Nov 05 03:44:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 3d9b111a-a59d-4ac8-928c-0b5c2087f5b1: deleting
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 3d9b111a-a59d-4ac8-928c-0b5c2087f5b1: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-adb5cc3a-9d17-47c9-9824-1d5341824dce" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-adb5cc3a-9d17-47c9-9824-1d5341824dce" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Deleting offline snapshot adb5cc3a-9d17-47c9-9824-1d5341824dce of volume e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] snapshot_file for this snap is: volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0546ec8d-50c6-43e1-a250-232781bc11bd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-15fe600b-26fa-4370-9978-773f7d297af3 tempest-ServerActionsTestOtherA-813450021 None] Terminate volume connection completed successfully.
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-15fe600b-26fa-4370-9978-773f7d297af3 tempest-ServerActionsTestOtherA-813450021 None] Deleting attachment c479d63f-0a76-4b14-a932-1b82a1e1da1e. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:44:56 devstack sudo[93591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce
Nov 05 03:44:56 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "cinder-c06bf5a9-3049-4a27-9280-4e08dc10d465-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-c06bf5a9-3049-4a27-9280-4e08dc10d465-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "cinder-quobyte-c06bf5a9-3049-4a27-9280-4e08dc10d465" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-quobyte-c06bf5a9-3049-4a27-9280-4e08dc10d465" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab93263-d324-4307-8667-5424526703a9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:57 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce" returned: 0 in 0.694s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:44:57 devstack sudo[93596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465
Nov 05 03:44:57 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4117487-4ed2-4e58-999e-008c93d2890d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:57 devstack sudo[93599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9
Nov 05 03:44:57 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:57 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465" returned: 0 in 0.664s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:57 devstack sudo[93606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465
Nov 05 03:44:57 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "cinder-3348a013-75a6-4898-aeef-3d9d13740b2d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-3348a013-75a6-4898-aeef-3d9d13740b2d-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:58 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" returned: 0 in 1.051s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:58 devstack sudo[93627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce
Nov 05 03:44:58 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "cinder-quobyte-3348a013-75a6-4898-aeef-3d9d13740b2d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-quobyte-3348a013-75a6-4898-aeef-3d9d13740b2d" acquired by "delete_volume" :: waited 0.071s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68e0693-a06f-4331-8f1c-a89569648e29]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:58 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c06bf5a9-3049-4a27-9280-4e08dc10d465" returned: 0 in 1.086s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-quobyte-c06bf5a9-3049-4a27-9280-4e08dc10d465" released by "delete_volume" :: held 1.885s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:44:58 devstack sudo[93653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d
Nov 05 03:44:58 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG cinder.quota [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Created reservations ['60d0a5ff-abc4-46f2-8acd-fc03ef91ca5d', 'a3404f2a-0de0-4295-a131-5b8826fce112', '192b1448-fc54-445e-a687-e5cc537bf2db', 'a337c548-7bda-46c9-b5d4-b0a02e7b832a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:59 devstack sudo[93682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:44:59 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:59 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce" returned: 0 in 1.148s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:44:59 devstack sudo[93691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce
Nov 05 03:44:59 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.651s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:44:59 devstack cinder-volume[87098]: DEBUG cinder.manager [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:44:59 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root
Nov 05 03:44:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Deleted volume successfully.
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-00e4c36a-8d68-42de-9218-238eba62ab97 req-103a18e2-4284-440e-9450-190647f672a2 tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-c06bf5a9-3049-4a27-9280-4e08dc10d465-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:00 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d" returned: 0 in 1.499s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:00 devstack sudo[93709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d
Nov 05 03:45:00 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:00 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9.adb5cc3a-9d17-47c9-9824-1d5341824dce" returned: 0 in 0.929s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:00 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3348a013-75a6-4898-aeef-3d9d13740b2d" returned: 0 in 0.412s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-adb5cc3a-9d17-47c9-9824-1d5341824dce" released by "_delete_snapshot" :: held 4.094s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-quobyte-3348a013-75a6-4898-aeef-3d9d13740b2d" released by "delete_volume" :: held 2.056s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" released by "delete_snapshot" :: held 4.141s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Deleting offline snapshot d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 of volume 4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] snapshot_file for this snap is: volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3122e56-4508-4e3f-b712-5d5049020fd2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Created reservations ['555919e5-12c0-43db-9cd9-e3397e5bf077', '130d7b76-83a9-4fe2-ba17-22009b0e3737', 'ebd5f36a-19b7-46cd-a9e7-47cb521d276c', 'e132347f-c29c-4ec0-aa51-3c804c601533'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:00 devstack sudo[93718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6
Nov 05 03:45:00 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:00 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:45:00 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:01 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59bfd44-3750-4df8-a290-0bed83b76dd5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:01 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.344s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Deleted volume successfully.
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-70542b69-59e0-4f36-91f2-21a926c33b8d tempest-ServerActionsTestOtherA-813450021 None] Lock "cinder-3348a013-75a6-4898-aeef-3d9d13740b2d-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:01 devstack sudo[93728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa
Nov 05 03:45:01 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:01 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" returned: 0 in 0.694s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:01 devstack sudo[93738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6
Nov 05 03:45:01 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:02 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" returned: 0 in 0.622s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:02 devstack sudo[93748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6
Nov 05 03:45:02 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:02 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa.d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" returned: 0 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-d5a8c7f6-ce71-4988-9dc9-286b4c4704c6" released by "_delete_snapshot" :: held 2.365s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" released by "delete_snapshot" :: held 2.415s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:03 devstack cinder-volume[87098]: WARNING cinder.quota [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2032867331 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2032867331, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:45:03 devstack cinder-volume[87098]: WARNING cinder.quota [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2032867331 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2032867331, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:45:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['515d28bb-5d2d-4d44-a9ad-07e26989008d', '97bb790e-f5f4-4c14-add3-01d45bae8f48', '60a611ff-a300-402f-97a4-37d94162afa8', '1cedd09d-3218-4a0e-9b1a-26938c28a012'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['341f2869-c87c-4813-a659-0fa260de7311', '6e40d265-0479-448a-a8bb-5acb8704c77e', 'bedcbb55-714e-4d90-a439-2d64cd3046f6', '2c3ad654-87b7-4255-8441-6f27044cefd4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0d59de15-665c-4f47-af7f-15748f5b09d3 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 3d9b111a-a59d-4ac8-928c-0b5c2087f5b1: deleted successfully
Nov 05 03:45:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a94cf-3156-4af9-b534-bcf1a06eb26f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:05 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa
Nov 05 03:45:05 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:06 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" returned: 0 in 0.672s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:06 devstack sudo[93806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa
Nov 05 03:45:06 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:06 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-4d93ecb2-6e92-4c65-a0b2-90cd300656aa" released by "delete_volume" :: held 1.126s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa3eb9-1b51-48c3-80eb-7945c6034c90]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:06 devstack sudo[93811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9
Nov 05 03:45:06 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Acquiring lock "cinder-d24e2446-e377-44a5-840d-36cfe49b8475-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:07 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" returned: 0 in 0.529s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "cinder-d24e2446-e377-44a5-840d-36cfe49b8475-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:07 devstack sudo[93816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9
Nov 05 03:45:07 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Acquiring lock "cinder-quobyte-d24e2446-e377-44a5-840d-36cfe49b8475" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "cinder-quobyte-d24e2446-e377-44a5-840d-36cfe49b8475" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b90512-b3b8-4715-94f3-1481ae835a39]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:07 devstack sudo[93818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475
Nov 05 03:45:07 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:07 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-e5f00715-ac9b-4995-b491-77e0e3d9e0d9" released by "delete_volume" :: held 1.074s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['9b0018e7-42e0-4dfa-b863-3223860ceb2e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:07 devstack cinder-volume[87098]: WARNING cinder.quota [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2032867331 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2032867331, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['829773f3-0bb8-4405-969d-9dd473522a6e', '02756fc6-f67d-4279-96e2-05336fb27588', 'dc5cd87b-7b01-4c8a-840a-74a099fe9304', '48c01d43-b1d8-41b0-b0fc-4f98e3232b73'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:07 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:07 devstack sudo[93826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475
Nov 05 03:45:07 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['a30de808-fd9f-495c-aab9-b4b8e156e147', '7351c7f3-6586-4a92-b479-6f682435528c', 'a4f5bdb0-1e23-4abb-885a-4cd4f19e7e23', '2be38837-7130-482a-a5cc-2afe62743e61'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:08 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d24e2446-e377-44a5-840d-36cfe49b8475" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:08 devstack sudo[93829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:45:08 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "cinder-quobyte-d24e2446-e377-44a5-840d-36cfe49b8475" released by "delete_volume" :: held 1.030s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Created reservations ['d1286ff5-8563-4688-992b-cb8d0fb9ce4e', '97b1e78a-b35a-43be-9d5d-5b0859691ccd', '47c019a1-9633-42de-b486-c030861d402e', '0faa8678-ba9a-4d9d-b4c1-673362c1738f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:08 devstack sudo[93831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:45:08 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:08 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-28869cf0-eaaf-40c5-9758-b9a584904604 tempest-GroupSnapshotsTest-793217181 None] Delete group completed successfully.
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:08 devstack sudo[93834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:45:08 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:08 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Deleted volume successfully.
Nov 05 03:45:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7bb77422-1a9b-44de-8966-5413b290a6f4 tempest-AttachVolumeShelveTestJSON-531543952 None] Lock "cinder-d24e2446-e377-44a5-840d-36cfe49b8475-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:09 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:45:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:45:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:45:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87fd2dba-026d-4cc1-ae17-a0fd0e071737 tempest-GroupSnapshotsTest-793217181 None] Group tempest-GroupSnapshotsTest-Group-438000831: creating
Nov 05 03:45:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87fd2dba-026d-4cc1-ae17-a0fd0e071737 tempest-GroupSnapshotsTest-793217181 None] Group tempest-GroupSnapshotsTest-Group-438000831: created successfully
Nov 05 03:45:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87fd2dba-026d-4cc1-ae17-a0fd0e071737 tempest-GroupSnapshotsTest-793217181 None] Create group completed successfully.
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (1438bb7f-8c18-42ff-94bb-1296456d1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b9aa0e-4771-4cdb-9e79-dfd6641123bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b9aa0e-4771-4cdb-9e79-dfd6641123bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-943300772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01add1d9-494f-4869-ad60-b7c276657cc4,host='devstack@QuobyteHD#QuobyteHD',id=989f4919-ec67-41ac-ad70-12b5f26a9902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:11Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca3b5fb-e64e-4457-b686-28bd1d26f94a),volume_type_id=2ca3b5fb-e64e-4457-b686-28bd1d26f94a)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaac39c-9b1c-4d29-a6a3-08f1db81bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaac39c-9b1c-4d29-a6a3-08f1db81bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742371fa-4ff7-4587-a915-9dcd7b4084f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742371fa-4ff7-4587-a915-9dcd7b4084f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989f4919-ec67-41ac-ad70-12b5f26a9902', 'volume_name': 'volume-989f4919-ec67-41ac-ad70-12b5f26a9902', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b42cb21-d4b4-4607-b345-780af38c8a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b42cb21-d4b4-4607-b345-780af38c8a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfbd983-f3ea-4de6-9fe6-a206921a2e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Volume 989f4919-ec67-41ac-ad70-12b5f26a9902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989f4919-ec67-41ac-ad70-12b5f26a9902', 'volume_size': 1}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=01add1d9-494f-4869-ad60-b7c276657cc4,created_at=2026-11-05T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-943300772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01add1d9-494f-4869-ad60-b7c276657cc4,host='devstack@QuobyteHD#QuobyteHD',id=989f4919-ec67-41ac-ad70-12b5f26a9902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fbd2a5e39f4d519ee70e334e608b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:11Z,use_quota=True,user_id='e90ace3be49f46fdbf08cb6bb7647136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca3b5fb-e64e-4457-b686-28bd1d26f94a),volume_type_id=2ca3b5fb-e64e-4457-b686-28bd1d26f94a)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Creating volume 989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:45:11 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:45:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:11 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 1073741824
Nov 05 03:45:11 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:12 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 1073741824" returned: 0 in 0.700s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:12 devstack sudo[93847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902
Nov 05 03:45:12 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:12 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfbd983-f3ea-4de6-9fe6-a206921a2e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989f4919-ec67-41ac-ad70-12b5f26a9902', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4030e6-5c1b-4f97-a836-a6a5d9fdadb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:45:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Volume volume-989f4919-ec67-41ac-ad70-12b5f26a9902 (989f4919-ec67-41ac-ad70-12b5f26a9902): created successfully
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4030e6-5c1b-4f97-a836-a6a5d9fdadb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:45:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Flow 'volume_create_manager' (1438bb7f-8c18-42ff-94bb-1296456d1224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:45:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-01e3a999-3db5-40e6-bfdf-7990013e24cd tempest-GroupSnapshotsTest-793217181 None] Created volume successfully.
Nov 05 03:45:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] GroupSnapshot 6d237153-ed6f-4fe1-8087-05da99419250: creating.
Nov 05 03:45:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Group snapshot 6d237153-ed6f-4fe1-8087-05da99419250: creating. {{(pid=87098) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}}
Nov 05 03:45:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Creating offline snapshot 1609c36b-94f6-4625-bcde-a2e4814eb2f9 of volume 989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:45:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ac493-51cf-482c-abff-9692be0fe0db]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:14 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902
Nov 05 03:45:14 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:14 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902" returned: 0 in 0.727s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:15 devstack sudo[93859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 1G
Nov 05 03:45:15 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:15 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 1G" returned: 0 in 0.750s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989f4919-ec67-41ac-ad70-12b5f26a9902 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:15 devstack sudo[93865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989f4919-ec67-41ac-ad70-12b5f26a9902 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9
Nov 05 03:45:15 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:16 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-989f4919-ec67-41ac-ad70-12b5f26a9902 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9" returned: 0 in 0.560s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:16 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:45:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:16 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9
Nov 05 03:45:16 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:16 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:16 devstack sudo[93875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info
Nov 05 03:45:16 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:17 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:17 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:17 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info
Nov 05 03:45:17 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:17 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.info" returned: 0 in 0.343s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.287s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a0d87bd3-e007-4ccc-af5e-90c11da1a144 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 6d237153-ed6f-4fe1-8087-05da99419250: created successfully
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Acquiring lock "cinder-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Lock "cinder-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Acquiring lock "cinder-quobyte-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Lock "cinder-quobyte-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7a1c1a-b4e2-4839-a432-0b7dd9f40409]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:18 devstack sudo[93881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7
Nov 05 03:45:18 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:18 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7" returned: 0 in 0.432s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:18 devstack sudo[93886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7
Nov 05 03:45:18 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:18 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Lock "cinder-quobyte-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7" released by "delete_volume" :: held 0.804s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 6d237153-ed6f-4fe1-8087-05da99419250: deleting
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 6d237153-ed6f-4fe1-8087-05da99419250: deleting {{(pid=87098) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Created reservations ['55eb806e-e7ea-4466-8bb0-62480987696d', '9796576c-9610-432d-9a4b-d19e6d1193b1', '89e99d04-6f63-4193-96d5-478da8986061', '8a9da54e-4c5c-4f95-b600-7c9e050980cf'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-989f4919-ec67-41ac-ad70-12b5f26a9902" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-989f4919-ec67-41ac-ad70-12b5f26a9902" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-1609c36b-94f6-4625-bcde-a2e4814eb2f9" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-1609c36b-94f6-4625-bcde-a2e4814eb2f9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Deleting offline snapshot 1609c36b-94f6-4625-bcde-a2e4814eb2f9 of volume 989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] snapshot_file for this snap is: volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8ff56-cab2-439c-a49e-5b1cb645f579]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:19 devstack sudo[93890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:45:19 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:19 devstack sudo[93889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9
Nov 05 03:45:19 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:19 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Deleted volume successfully.
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-82b9a4b8-5cc2-4ccd-a4f1-e5162ddb43af tempest-VolumesNegativeTest-2035048480 None] Lock "cinder-dabf13d5-bf19-4ac5-b0ac-d64fa28b5ce7-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:19 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9" returned: 0 in 0.731s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-989f4919-ec67-41ac-ad70-12b5f26a9902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7018f876-ccc8-497b-9b0c-1d227a696e22]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:19 devstack sudo[93897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902
Nov 05 03:45:19 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:20 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902" returned: 0 in 0.491s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:20 devstack sudo[93902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9
Nov 05 03:45:20 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:20 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9" returned: 0 in 0.468s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:20 devstack sudo[93908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9
Nov 05 03:45:20 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:21 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902.1609c36b-94f6-4625-bcde-a2e4814eb2f9" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-1609c36b-94f6-4625-bcde-a2e4814eb2f9" released by "_delete_snapshot" :: held 2.175s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-989f4919-ec67-41ac-ad70-12b5f26a9902" released by "delete_snapshot" :: held 2.213s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:21 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=132,cinder:INSERT=42,cinder:UPDATE=157,cinder:DELETE=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:45:21 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=135,cinder:SELECT=140,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:45:21 devstack cinder-volume[87098]: WARNING cinder.quota [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-635216743 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-635216743, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:45:21 devstack cinder-volume[87098]: WARNING cinder.quota [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-635216743 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-635216743, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:45:21 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['1648450e-d025-41c3-9664-b935faea8ca3', 'dadde601-98c4-4bf0-a85f-ffa82f4c7de6', '555b8ac0-81a1-4c7b-8f1b-a9a94988b31d', '04e5d2f2-fa4f-4502-b044-d39eb6b9c127'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-85f7e0f0-e598-4cec-96ce-cd5d4911b5e5 tempest-GroupSnapshotsTest-793217181 None] group_snapshot 6d237153-ed6f-4fe1-8087-05da99419250: deleted successfully
Nov 05 03:45:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "cinder-quobyte-989f4919-ec67-41ac-ad70-12b5f26a9902" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:45:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-989f4919-ec67-41ac-ad70-12b5f26a9902" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:45:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fa8f1e-1159-4ea0-9426-f04adaeaf0df]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:45:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:23 devstack sudo[93911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902
Nov 05 03:45:23 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:23 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:23 devstack sudo[93916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902
Nov 05 03:45:23 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:23 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-989f4919-ec67-41ac-ad70-12b5f26a9902" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Lock "cinder-quobyte-989f4919-ec67-41ac-ad70-12b5f26a9902" released by "delete_volume" :: held 1.011s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:45:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['967cdc45-68fe-4651-a912-ca0adcef66bc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:23 devstack cinder-volume[87098]: WARNING cinder.quota [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-635216743 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-635216743, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Created reservations ['c4427fdb-eae2-4971-88e8-93a4a6585f85', '0535ae1c-738b-4844-b4be-470cbe75d0e6', '5bc8c067-3225-445b-9eec-bd795c26774d', '59e716eb-c142-4dd0-8a50-f2fb0957c7d9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:45:24 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:45:24 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:45:24 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:45:24 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:45:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-54b4022c-5fc2-40b5-bb57-a8f4514d5718 tempest-GroupSnapshotsTest-793217181 None] Delete group completed successfully.
Nov 05 03:45:34 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=16 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:45:34 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=17 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:08 devstack sudo[94229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:46:08 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:09 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.942s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:46:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:46:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:46:13 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Flow 'volume_create_manager' (ddba470b-9bb6-43b6-ad0b-aebc60b9166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b5dc1d-b43f-4d7c-8e62-9995c989ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b5dc1d-b43f-4d7c-8e62-9995c989ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-161831975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a01c62-7e05-488d-8be0-2b71b6be2d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e93cc794ee4e4297b9574078740821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:14Z,use_quota=True,user_id='d17e9b5d55674869bfa6245115a74f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60f18fe3-62a0-43fa-9203-5ad631db7993),volume_type_id=60f18fe3-62a0-43fa-9203-5ad631db7993)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e862bef-2d49-4c82-a530-c1af8c02c785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e862bef-2d49-4c82-a530-c1af8c02c785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5dba20-6e01-48e3-8832-ea6b11da05fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5dba20-6e01-48e3-8832-ea6b11da05fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a01c62-7e05-488d-8be0-2b71b6be2d19', 'volume_name': 'volume-22a01c62-7e05-488d-8be0-2b71b6be2d19', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d4086f-9228-49cd-8c5b-81074a18e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d4086f-9228-49cd-8c5b-81074a18e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b419c024-67b6-419a-b528-e39afb5ba647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:14 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume 22a01c62-7e05-488d-8be0-2b71b6be2d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a01c62-7e05-488d-8be0-2b71b6be2d19', 'volume_size': 1}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-161831975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a01c62-7e05-488d-8be0-2b71b6be2d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e93cc794ee4e4297b9574078740821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:14Z,use_quota=True,user_id='d17e9b5d55674869bfa6245115a74f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60f18fe3-62a0-43fa-9203-5ad631db7993),volume_type_id=60f18fe3-62a0-43fa-9203-5ad631db7993)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Creating volume 22a01c62-7e05-488d-8be0-2b71b6be2d19 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:14 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:46:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:14 devstack sudo[94280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 1073741824
Nov 05 03:46:14 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:15 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 1073741824" returned: 0 in 0.980s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:15 devstack sudo[94287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19
Nov 05 03:46:15 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87946cf3-ad18-458f-96a4-632c8473098d tempest-GroupsV320Test-1659267162 None] Group tempest-GroupsV320Test-Group-703858518: creating
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Flow 'volume_create_manager' (a5aabeae-d5c2-43bd-b181-8e5e06dab77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54ecf9f-ea12-4a9e-a846-e7e17098d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54ecf9f-ea12-4a9e-a846-e7e17098d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-53150398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e026f6fa-1810-479a-8b37-b4ae7c706797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e93cc794ee4e4297b9574078740821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:15Z,use_quota=True,user_id='d17e9b5d55674869bfa6245115a74f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52396a9c-b680-43d6-9afe-ad669112ec17),volume_type_id=52396a9c-b680-43d6-9afe-ad669112ec17)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7c1c69-d90b-46a9-a0ee-b646b1dd02cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7c1c69-d90b-46a9-a0ee-b646b1dd02cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a27efc-046e-47ea-b301-0214cd60fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a27efc-046e-47ea-b301-0214cd60fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e026f6fa-1810-479a-8b37-b4ae7c706797', 'volume_name': 'volume-e026f6fa-1810-479a-8b37-b4ae7c706797', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c909b9-fbda-4f15-8e0b-3c68dbefa0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c909b9-fbda-4f15-8e0b-3c68dbefa0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce9908c-18c4-43aa-90b8-f976be9b15e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume e026f6fa-1810-479a-8b37-b4ae7c706797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e026f6fa-1810-479a-8b37-b4ae7c706797', 'volume_size': 1}
Nov 05 03:46:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87946cf3-ad18-458f-96a4-632c8473098d tempest-GroupsV320Test-1659267162 None] Group tempest-GroupsV320Test-Group-703858518: created successfully
Nov 05 03:46:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87946cf3-ad18-458f-96a4-632c8473098d tempest-GroupsV320Test-1659267162 None] Create group completed successfully.
Nov 05 03:46:16 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19" returned: 0 in 0.978s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-53150398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e026f6fa-1810-479a-8b37-b4ae7c706797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e93cc794ee4e4297b9574078740821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:15Z,use_quota=True,user_id='d17e9b5d55674869bfa6245115a74f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52396a9c-b680-43d6-9afe-ad669112ec17),volume_type_id=52396a9c-b680-43d6-9afe-ad669112ec17)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Creating volume e026f6fa-1810-479a-8b37-b4ae7c706797 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b419c024-67b6-419a-b528-e39afb5ba647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a01c62-7e05-488d-8be0-2b71b6be2d19', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:16 devstack sudo[94291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797 1073741824
Nov 05 03:46:16 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450d6d4-5845-4f57-8a97-412f92861e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 (22a01c62-7e05-488d-8be0-2b71b6be2d19): created successfully
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450d6d4-5845-4f57-8a97-412f92861e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Flow 'volume_create_manager' (ddba470b-9bb6-43b6-ad0b-aebc60b9166d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d1f7bc9e-ec85-4d5b-9164-2b4d4d0495f7 tempest-TestInstancesWithCinderVolumes-1256022751 None] Created volume successfully.
Nov 05 03:46:17 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797 1073741824" returned: 0 in 1.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Flow 'volume_create_manager' (d3dd8d76-905d-4bc7-88ee-2bbb0f720780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4ec53e-6048-41b4-b0f4-4a034351b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4ec53e-6048-41b4-b0f4-4a034351b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-544526030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473556da-5e66-4bd1-8472-7e68d3b384cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e93cc794ee4e4297b9574078740821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:18Z,use_quota=True,user_id='d17e9b5d55674869bfa6245115a74f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6ffc85-28eb-4a46-99f5-dbf894192bb4),volume_type_id=7a6ffc85-28eb-4a46-99f5-dbf894192bb4)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d541adc-be6b-4aeb-bb82-40a6fb5e6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:18 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d541adc-be6b-4aeb-bb82-40a6fb5e6e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:18 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f9ba70-09e7-43ed-b2bc-3352d772efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:46:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Created reservations ['757d4237-1a2b-4a67-9eae-a79b1a1309f2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:19 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797" returned: 0 in 0.776s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] <== create_volume: return (2896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.903s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce9908c-18c4-43aa-90b8-f976be9b15e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e026f6fa-1810-479a-8b37-b4ae7c706797', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a904c31-db22-485c-8df6-2304b74271ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:19 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:46:19 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume volume-e026f6fa-1810-479a-8b37-b4ae7c706797 (e026f6fa-1810-479a-8b37-b4ae7c706797): created successfully
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a904c31-db22-485c-8df6-2304b74271ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Flow 'volume_create_manager' (a5aabeae-d5c2-43bd-b181-8e5e06dab77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a63869ec-d062-4dac-b910-add64ef4e21d tempest-TestInstancesWithCinderVolumes-1256022751 None] Created volume successfully.
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Flow 'volume_create_manager' (46f9ef13-4a1c-4ab4-97ca-3f4ae8416b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a6aa9-952d-4a92-b38f-c58b1a2f7e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835a6aa9-952d-4a92-b38f-c58b1a2f7e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-282157511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aad9f48d57549a88a6b0c59e555f17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:19Z,use_quota=True,user_id='28dc1efa1836476ca08ea6251870e007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fbe5d0-dd35-4b51-8ef4-7e48be13ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fbe5d0-dd35-4b51-8ef4-7e48be13ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e475535-0c98-4aaf-941a-feab30ae7be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e475535-0c98-4aaf-941a-feab30ae7be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa', 'volume_name': 'volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdddd4a-2270-4a4b-843c-dbd930775f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdddd4a-2270-4a4b-843c-dbd930775f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fd04c1-ecce-4120-82c5-88a82b4937bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Volume 8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa', 'volume_size': 1}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-282157511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aad9f48d57549a88a6b0c59e555f17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:19Z,use_quota=True,user_id='28dc1efa1836476ca08ea6251870e007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Creating volume 8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:20 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:20 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.940s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8edea2d2-7927-444d-a92f-cb46218c5a22 tempest-GroupsV320Test-1659267162 None] Delete group completed successfully.
Nov 05 03:46:20 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa 1073741824
Nov 05 03:46:20 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f9ba70-09e7-43ed-b2bc-3352d772efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '473556da-5e66-4bd1-8472-7e68d3b384cf', 'volume_name': 'volume-473556da-5e66-4bd1-8472-7e68d3b384cf', 'volume_size': 1, 'image_id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38b4684a-090c-4e2e-b8eb-fb343867a40f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2113451839', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92e93cc794ee4e4297b9574078740821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'created_at': datetime.datetime(2026, 11, 5, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 46, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38b4684a-090c-4e2e-b8eb-fb343867a40f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72ae3d850>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ae318f-9bdd-4ba5-9328-06fdffa410c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ae318f-9bdd-4ba5-9328-06fdffa410c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a50f43d-8362-4e6c-8a8e-73a8665957f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume 473556da-5e66-4bd1-8472-7e68d3b384cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-473556da-5e66-4bd1-8472-7e68d3b384cf', 'volume_size': 1, 'image_id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38b4684a-090c-4e2e-b8eb-fb343867a40f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2113451839', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92e93cc794ee4e4297b9574078740821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'created_at': datetime.datetime(2026, 11, 5, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 46, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38b4684a-090c-4e2e-b8eb-fb343867a40f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72ae3d850>}
Nov 05 03:46:20 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Trying to clone 473556da-5e66-4bd1-8472-7e68d3b384cf from image 38b4684a-090c-4e2e-b8eb-fb343867a40f at location (None, [{'url': 'file:///opt/stack/data/glance/images/38b4684a-090c-4e2e-b8eb-fb343867a40f', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:46:21 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa 1073741824" returned: 0 in 1.061s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:21 devstack sudo[94341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa
Nov 05 03:46:21 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:21 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa" returned: 0 in 0.527s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fd04c1-ecce-4120-82c5-88a82b4937bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faef9ea-487c-4b25-a80b-d732a41e33c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Volume volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa (8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa): created successfully
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faef9ea-487c-4b25-a80b-d732a41e33c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Flow 'volume_create_manager' (46f9ef13-4a1c-4ab4-97ca-3f4ae8416b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f4340acd-07bd-4792-beb2-f183fc37dc6d tempest-ServerRescueNegativeTestJSON-576734472 None] Created volume successfully.
Nov 05 03:46:27 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD, size 20.69 MB, duration 6.99 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:46:27 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Image download 20.69 MB at 2.96 MB/s
Nov 05 03:46:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ab3a3e-fc17-4ebe-b388-8966460d91d1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:27 devstack sudo[94413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD
Nov 05 03:46:27 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:28 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Temporary image 38b4684a-090c-4e2e-b8eb-fb343867a40f is fetched for user d17e9b5d55674869bfa6245115a74f41. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe48c3-22f9-4abc-8b4b-eb471fc65825]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:28 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD
Nov 05 03:46:28 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:28 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-544526030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473556da-5e66-4bd1-8472-7e68d3b384cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e93cc794ee4e4297b9574078740821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:18Z,use_quota=True,user_id='d17e9b5d55674869bfa6245115a74f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6ffc85-28eb-4a46-99f5-dbf894192bb4),volume_type_id=7a6ffc85-28eb-4a46-99f5-dbf894192bb4)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Creating volume 473556da-5e66-4bd1-8472-7e68d3b384cf {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:28 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:46:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:28 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf 1073741824
Nov 05 03:46:28 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:30 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf 1073741824" returned: 0 in 1.212s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:30 devstack sudo[94431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf
Nov 05 03:46:30 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:30 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Attempting download of 38b4684a-090c-4e2e-b8eb-fb343867a40f ((None, [{'url': 'file:///opt/stack/data/glance/images/38b4684a-090c-4e2e-b8eb-fb343867a40f', 'metadata': {}}])) to volume 473556da-5e66-4bd1-8472-7e68d3b384cf. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751c0a4-f8d7-432c-9ac7-32757e5b7f64]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:30 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz
Nov 05 03:46:30 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:31 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz" returned: 0 in 0.609s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:31 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz
Nov 05 03:46:31 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:31 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz" returned: 1 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_38b4684a-090c-4e2e-b8eb-fb343867a40f_hwz4ypzz' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:46:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baab601-c42b-4bcf-bf0b-77cb32938f53]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:31 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD
Nov 05 03:46:31 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:32 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD" returned: 0 in 0.574s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:32 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] 38b4684a-090c-4e2e-b8eb-fb343867a40f was qcow2, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:46:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:32 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf
Nov 05 03:46:32 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Acquiring lock "cinder-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "cinder-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Acquiring lock "cinder-quobyte-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:46:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "cinder-quobyte-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:46:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9dc9d0-7b4d-4cd5-ac91-b34c457eb0cd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:46:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:33 devstack sudo[94500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa
Nov 05 03:46:33 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:34 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa" returned: 0 in 0.721s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:34 devstack sudo[94507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa
Nov 05 03:46:34 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:34 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "cinder-quobyte-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa" released by "delete_volume" :: held 1.348s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Created reservations ['f67784f3-910c-429a-aad7-4e6828d213b0', '31fcaba3-2424-475a-9a9d-99c448e0b4f9', '64927fba-6341-4bb5-ad1a-0729441b5356', '19dcc7e3-5aff-482b-a4d1-3f59a8d9e936'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:35 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:46:35 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:35 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.526s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:46:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Deleted volume successfully.
Nov 05 03:46:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4d32446-a5e1-488e-b209-423dc8c266d6 tempest-ServerRescueNegativeTestJSON-576734472 None] Lock "cinder-8a1576f0-dc04-44f3-a68b-e5e4d3bb7bfa-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Flow 'volume_create_manager' (93515f31-f0f9-4df4-8b2a-19998b318668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae860ff8-e5eb-4f2f-a77c-3e312d21e52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae860ff8-e5eb-4f2f-a77c-3e312d21e52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1629464512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f8e53c-81f0-4676-94de-06471dece7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca246784fbf54ea9b692ff94eb8d2e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:36Z,use_quota=True,user_id='c081c78eda7444d9bd1d02a6c920a2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d389f0-829b-4719-9fea-70f18cb94dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d389f0-829b-4719-9fea-70f18cb94dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccc831b-d154-497c-bd1c-d40edf5d99f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccc831b-d154-497c-bd1c-d40edf5d99f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f8e53c-81f0-4676-94de-06471dece7ca', 'volume_name': 'volume-38f8e53c-81f0-4676-94de-06471dece7ca', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa591a58-3048-4351-9c63-e34788eb9430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa591a58-3048-4351-9c63-e34788eb9430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b253de2f-53fb-4c7b-a703-6588f35fff68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Volume 38f8e53c-81f0-4676-94de-06471dece7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f8e53c-81f0-4676-94de-06471dece7ca', 'volume_size': 1}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1629464512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f8e53c-81f0-4676-94de-06471dece7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca246784fbf54ea9b692ff94eb8d2e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:36Z,use_quota=True,user_id='c081c78eda7444d9bd1d02a6c920a2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Creating volume 38f8e53c-81f0-4676-94de-06471dece7ca {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:46:36 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:46:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf" returned: 0 in 4.124s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_38b4684a-090c-4e2e-b8eb-fb343867a40f_etagysq0devstack@QuobyteHD, size 112.00 MB, duration 4.13 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:46:36 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Converted 112.00 MB image at 27.12 MB/s
Nov 05 03:46:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:36 devstack sudo[94519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca 1073741824
Nov 05 03:46:36 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:36 devstack sudo[94526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf 1G
Nov 05 03:46:36 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:37 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf 1G" returned: 0 in 1.007s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Downloaded image 38b4684a-090c-4e2e-b8eb-fb343867a40f ((None, [{'url': 'file:///opt/stack/data/glance/images/38b4684a-090c-4e2e-b8eb-fb343867a40f', 'metadata': {}}])) to volume 473556da-5e66-4bd1-8472-7e68d3b384cf successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Temporary image 38b4684a-090c-4e2e-b8eb-fb343867a40f for user d17e9b5d55674869bfa6245115a74f41 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Marking volume 473556da-5e66-4bd1-8472-7e68d3b384cf as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Copying metadata from image 38b4684a-090c-4e2e-b8eb-fb343867a40f to 473556da-5e66-4bd1-8472-7e68d3b384cf. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Creating volume glance metadata for volume 473556da-5e66-4bd1-8472-7e68d3b384cf backed by image 38b4684a-090c-4e2e-b8eb-fb343867a40f with: {'image_id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'image_name': 'tempest-scenario-img--2113451839', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:46:37 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca 1073741824" returned: 0 in 1.137s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a50f43d-8362-4e6c-8a8e-73a8665957f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-473556da-5e66-4bd1-8472-7e68d3b384cf', 'volume_size': 1, 'image_id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/38b4684a-090c-4e2e-b8eb-fb343867a40f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2113451839', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92e93cc794ee4e4297b9574078740821', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '38b4684a-090c-4e2e-b8eb-fb343867a40f', 'created_at': datetime.datetime(2026, 11, 5, 2, 46, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 46, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/38b4684a-090c-4e2e-b8eb-fb343867a40f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72ae3d850>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c597ed37-56f5-4bb4-a20f-cafed5b7bc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:46:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Volume volume-473556da-5e66-4bd1-8472-7e68d3b384cf (473556da-5e66-4bd1-8472-7e68d3b384cf): created successfully
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c597ed37-56f5-4bb4-a20f-cafed5b7bc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Flow 'volume_create_manager' (d3dd8d76-905d-4bc7-88ee-2bbb0f720780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:37 devstack sudo[94554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca
Nov 05 03:46:37 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:46:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3f163437-89c7-4d67-8993-e6a3800f0158 tempest-TestInstancesWithCinderVolumes-1256022751 None] Created volume successfully.
Nov 05 03:46:38 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b253de2f-53fb-4c7b-a703-6588f35fff68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f8e53c-81f0-4676-94de-06471dece7ca', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b802f77-d37f-42c6-a89c-7b94b67d864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:46:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Volume volume-38f8e53c-81f0-4676-94de-06471dece7ca (38f8e53c-81f0-4676-94de-06471dece7ca): created successfully
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b802f77-d37f-42c6-a89c-7b94b67d864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:46:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Flow 'volume_create_manager' (93515f31-f0f9-4df4-8b2a-19998b318668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:46:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-038bbeb9-19a6-43b8-93ce-a01ffbe81d18 tempest-AttachVolumeNegativeTest-1809005525 None] Created volume successfully.
Nov 05 03:46:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-ba95229b-e9f5-47e9-9d96-d8a42ba470ab req-3e74e219-cbd6-490f-978c-8a7822eef8fe tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-ba95229b-e9f5-47e9-9d96-d8a42ba470ab req-3e74e219-cbd6-490f-978c-8a7822eef8fe tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-ba95229b-e9f5-47e9-9d96-d8a42ba470ab req-3e74e219-cbd6-490f-978c-8a7822eef8fe tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-ba95229b-e9f5-47e9-9d96-d8a42ba470ab req-3e74e219-cbd6-490f-978c-8a7822eef8fe tempest-AttachVolumeNegativeTest-1809005525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-38f8e53c-81f0-4676-94de-06471dece7ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11dde144-fa96-4511-b95e-8ed018c6eac1', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:46:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-ba95229b-e9f5-47e9-9d96-d8a42ba470ab req-3e74e219-cbd6-490f-978c-8a7822eef8fe tempest-AttachVolumeNegativeTest-1809005525 None] attachment_update completed successfully.
Nov 05 03:46:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-f191b4b5-42ba-4783-aa73-bc830a8d0a7a req-4c22bb73-5781-46ce-8041-744ed6ef84db tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:46:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-f191b4b5-42ba-4783-aa73-bc830a8d0a7a req-4c22bb73-5781-46ce-8041-744ed6ef84db tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:46:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-f191b4b5-42ba-4783-aa73-bc830a8d0a7a req-4c22bb73-5781-46ce-8041-744ed6ef84db tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:46:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-f191b4b5-42ba-4783-aa73-bc830a8d0a7a req-4c22bb73-5781-46ce-8041-744ed6ef84db tempest-TestInstancesWithCinderVolumes-1256022751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-473556da-5e66-4bd1-8472-7e68d3b384cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e0c5d25-658d-496e-ad08-a55e20ea6fd2', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:46:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-f191b4b5-42ba-4783-aa73-bc830a8d0a7a req-4c22bb73-5781-46ce-8041-744ed6ef84db tempest-TestInstancesWithCinderVolumes-1256022751 None] attachment_update completed successfully.
Nov 05 03:46:54 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=41,cinder:UPDATE=26,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:46:54 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=41,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:08 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:47:08 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:09 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:47:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:47:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:47:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2d22f409-d533-4743-b607-0d6a08548b5d req-be2c6236-f128-4224-bc2a-e892d84990c2 tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2d22f409-d533-4743-b607-0d6a08548b5d req-be2c6236-f128-4224-bc2a-e892d84990c2 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-2d22f409-d533-4743-b607-0d6a08548b5d req-be2c6236-f128-4224-bc2a-e892d84990c2 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-2d22f409-d533-4743-b607-0d6a08548b5d req-be2c6236-f128-4224-bc2a-e892d84990c2 tempest-TestInstancesWithCinderVolumes-1256022751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-22a01c62-7e05-488d-8be0-2b71b6be2d19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f84a2a9d-f22e-4a0c-8399-eb6f012e4c53', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:47:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-2d22f409-d533-4743-b607-0d6a08548b5d req-be2c6236-f128-4224-bc2a-e892d84990c2 tempest-TestInstancesWithCinderVolumes-1256022751 None] attachment_update completed successfully.
Nov 05 03:47:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-6c4fd949-2bdb-43e6-afe5-a27f94d888c1 req-adba87cd-6586-482d-8336-d24e62a48570 tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-6c4fd949-2bdb-43e6-afe5-a27f94d888c1 req-adba87cd-6586-482d-8336-d24e62a48570 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-6c4fd949-2bdb-43e6-afe5-a27f94d888c1 req-adba87cd-6586-482d-8336-d24e62a48570 tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-6c4fd949-2bdb-43e6-afe5-a27f94d888c1 req-adba87cd-6586-482d-8336-d24e62a48570 tempest-TestInstancesWithCinderVolumes-1256022751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-e026f6fa-1810-479a-8b37-b4ae7c706797', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd276648-4f16-4032-afe4-626a0f86d3bd', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:47:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-6c4fd949-2bdb-43e6-afe5-a27f94d888c1 req-adba87cd-6586-482d-8336-d24e62a48570 tempest-TestInstancesWithCinderVolumes-1256022751 None] attachment_update completed successfully.
Nov 05 03:47:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-c1dced36-c40f-40db-bed6-605cf4f73cc7 req-5e53ee68-55a3-4a24-9ba7-83f04a142c87 tempest-TestInstancesWithCinderVolumes-1256022751 None] Terminate volume connection completed successfully.
Nov 05 03:47:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-c1dced36-c40f-40db-bed6-605cf4f73cc7 req-5e53ee68-55a3-4a24-9ba7-83f04a142c87 tempest-TestInstancesWithCinderVolumes-1256022751 None] Deleting attachment f84a2a9d-f22e-4a0c-8399-eb6f012e4c53. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:47:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-617603cd-6901-4456-8826-e69af6c17108 req-f659c5bb-7efb-4f9f-89bc-9e4918ddc13f tempest-AttachVolumeNegativeTest-1809005525 None] Terminate volume connection completed successfully.
Nov 05 03:47:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-617603cd-6901-4456-8826-e69af6c17108 req-f659c5bb-7efb-4f9f-89bc-9e4918ddc13f tempest-AttachVolumeNegativeTest-1809005525 None] Deleting attachment 11dde144-fa96-4511-b95e-8ed018c6eac1. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:47:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "cinder-22a01c62-7e05-488d-8be0-2b71b6be2d19-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-22a01c62-7e05-488d-8be0-2b71b6be2d19-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "cinder-quobyte-22a01c62-7e05-488d-8be0-2b71b6be2d19" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-quobyte-22a01c62-7e05-488d-8be0-2b71b6be2d19" acquired by "delete_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ff254b-caf6-441d-8a1f-9a7473903e6b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:39 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19
Nov 05 03:47:39 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:40 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19" returned: 0 in 1.297s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:40 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19
Nov 05 03:47:40 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:41 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-22a01c62-7e05-488d-8be0-2b71b6be2d19" returned: 0 in 0.782s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-quobyte-22a01c62-7e05-488d-8be0-2b71b6be2d19" released by "delete_volume" :: held 2.255s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:41 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316421049-1389075617 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316421049-1389075617, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:47:41 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316421049-1389075617 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1316421049-1389075617, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Created reservations ['4dde299c-483e-4ae4-8a94-84eacbddd511', 'f6a7a84e-78e3-4e1d-b2a6-8459e777e64a', '409fcf46-82fd-4917-bc86-301f1db15a4a', '8038d08e-0191-4b38-adc8-7f55661a3131'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:41 devstack sudo[95543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:47:41 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:42 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 1.002s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Deleted volume successfully.
Nov 05 03:47:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2c47165d-7c98-468a-a512-f4ca2f876b1e tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-22a01c62-7e05-488d-8be0-2b71b6be2d19-delete_volume" released by "delete_volume" :: held 4.232s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-e792c50d-628e-4d2e-94e9-94d31a6adc68 req-5fce59b3-9807-4f15-9265-7f1aa31e9f04 tempest-TestInstancesWithCinderVolumes-1256022751 None] Terminate volume connection completed successfully.
Nov 05 03:47:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-e792c50d-628e-4d2e-94e9-94d31a6adc68 req-5fce59b3-9807-4f15-9265-7f1aa31e9f04 tempest-TestInstancesWithCinderVolumes-1256022751 None] Deleting attachment bd276648-4f16-4032-afe4-626a0f86d3bd. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:47:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "cinder-e026f6fa-1810-479a-8b37-b4ae7c706797-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-e026f6fa-1810-479a-8b37-b4ae7c706797-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "cinder-quobyte-e026f6fa-1810-479a-8b37-b4ae7c706797" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-quobyte-e026f6fa-1810-479a-8b37-b4ae7c706797" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f21ee-46b7-414a-a578-bc105a237b47]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:47 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797
Nov 05 03:47:47 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:48 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797" returned: 0 in 0.614s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:48 devstack sudo[95583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797
Nov 05 03:47:48 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:48 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e026f6fa-1810-479a-8b37-b4ae7c706797" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-quobyte-e026f6fa-1810-479a-8b37-b4ae7c706797" released by "delete_volume" :: held 1.106s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:48 devstack cinder-volume[87098]: WARNING cinder.quota [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1398139099-2004610781 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1398139099-2004610781, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:47:48 devstack cinder-volume[87098]: WARNING cinder.quota [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1398139099-2004610781 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1398139099-2004610781, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Created reservations ['ba16473d-83ef-4ca4-8323-f6924e6dd264', 'a459aed8-0f59-4f23-b915-1b7107ce6723', 'bd3ed8b5-da0e-4077-8331-922da311f887', '1bbc6b0f-8958-4148-84a9-151aac2eb7ab'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:47:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:48 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:47:48 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:47:49 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Nov 05 03:47:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:47:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:47:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Deleted volume successfully.
Nov 05 03:47:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-caa29b31-4a09-4204-a11a-5a02b898daec tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-e026f6fa-1810-479a-8b37-b4ae7c706797-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:47:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-06382201-9eb6-43a2-a0cc-35d264b1787c req-fddb9edc-107f-43a7-9e33-24ced8d5d3fd tempest-TestInstancesWithCinderVolumes-1256022751 None] Terminate volume connection completed successfully.
Nov 05 03:47:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-06382201-9eb6-43a2-a0cc-35d264b1787c req-fddb9edc-107f-43a7-9e33-24ced8d5d3fd tempest-TestInstancesWithCinderVolumes-1256022751 None] Deleting attachment 3e0c5d25-658d-496e-ad08-a55e20ea6fd2. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=30,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "cinder-473556da-5e66-4bd1-8472-7e68d3b384cf-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-473556da-5e66-4bd1-8472-7e68d3b384cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "cinder-quobyte-473556da-5e66-4bd1-8472-7e68d3b384cf" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-quobyte-473556da-5e66-4bd1-8472-7e68d3b384cf" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e667b-2d0b-4a29-8c86-d3abe6966218]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:47:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:47:59 devstack sudo[95677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf
Nov 05 03:47:59 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:00 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:00 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf
Nov 05 03:48:00 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:00 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-473556da-5e66-4bd1-8472-7e68d3b384cf" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-quobyte-473556da-5e66-4bd1-8472-7e68d3b384cf" released by "delete_volume" :: held 0.989s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:00 devstack cinder-volume[87098]: WARNING cinder.quota [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205433129-877961874 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205433129-877961874, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:48:00 devstack cinder-volume[87098]: WARNING cinder.quota [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205433129-877961874 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1205433129-877961874, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Created reservations ['e1dfb40a-b23c-4886-8517-a50ed836453f', 'c4060432-1a16-4fac-8bb3-cd04b22f5d6a', 'b21f5c6c-764b-494a-a945-eb7524759752', '829bec50-29aa-4e15-8ee9-d8c62dcf1a01'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:00 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:00 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:01 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Deleted volume successfully.
Nov 05 03:48:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1b1e6925-16ce-4bc2-a6cb-eca0ccd2262f tempest-TestInstancesWithCinderVolumes-1256022751 None] Lock "cinder-473556da-5e66-4bd1-8472-7e68d3b384cf-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:08 devstack sudo[95782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:08 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:09 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.644s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Flow 'volume_create_manager' (b5a48cf7-c444-42fa-a63a-720a9b1ec9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2ef0c5-4b5a-4f2c-9907-e4eb58512a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2ef0c5-4b5a-4f2c-9907-e4eb58512a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-885446621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b262e6-631a-48ce-b9ca-c3ead4e459a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd60fc57a6344a6aec20f9ba8697420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:09Z,use_quota=True,user_id='7fc742e845e24c2a90e8dfd115d3a5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce38276-4677-44c0-ac8a-d327a8250c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce38276-4677-44c0-ac8a-d327a8250c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcdb703-533b-4e8c-9ac0-eb50ea75dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcdb703-533b-4e8c-9ac0-eb50ea75dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b262e6-631a-48ce-b9ca-c3ead4e459a0', 'volume_name': 'volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07444f6-0a87-44bb-a5f9-8abf028397cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07444f6-0a87-44bb-a5f9-8abf028397cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a0a413-681c-4bac-8d8a-424d7ad6f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Volume 03b262e6-631a-48ce-b9ca-c3ead4e459a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0', 'volume_size': 1}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-885446621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b262e6-631a-48ce-b9ca-c3ead4e459a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd60fc57a6344a6aec20f9ba8697420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:09Z,use_quota=True,user_id='7fc742e845e24c2a90e8dfd115d3a5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Creating volume 03b262e6-631a-48ce-b9ca-c3ead4e459a0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:09 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:09 devstack sudo[95813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 1073741824
Nov 05 03:48:09 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:10 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 1073741824" returned: 0 in 1.015s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:10 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0
Nov 05 03:48:10 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:11 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0" returned: 0 in 1.232s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a0a413-681c-4bac-8d8a-424d7ad6f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57277d2e-fed2-49d6-bcbb-bb776bf8b318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Volume volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 (03b262e6-631a-48ce-b9ca-c3ead4e459a0): created successfully
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57277d2e-fed2-49d6-bcbb-bb776bf8b318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Flow 'volume_create_manager' (b5a48cf7-c444-42fa-a63a-720a9b1ec9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b67bb5e4-6882-4ad9-8319-ea513968cdb0 tempest-AttachVolumeTestJSON-1042114128 None] Created volume successfully.
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-24b8d63f-7445-4a7c-a48f-c114829e6323 req-ebcc3135-1cba-49aa-af57-218071f9a0ca tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-24b8d63f-7445-4a7c-a48f-c114829e6323 req-ebcc3135-1cba-49aa-af57-218071f9a0ca tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-24b8d63f-7445-4a7c-a48f-c114829e6323 req-ebcc3135-1cba-49aa-af57-218071f9a0ca tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.111s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (78d6b033-8cf6-4c41-a191-eb1df2479189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc81c0f7-8f46-462a-b920-83077a71f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc81c0f7-8f46-462a-b920-83077a71f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413236864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebc745d-af23-4967-974f-b64043105636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:16Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6691f3-8bfe-455b-a289-6a6a648f0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6691f3-8bfe-455b-a289-6a6a648f0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba735467-cc0b-4db6-a632-9674e2e16750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba735467-cc0b-4db6-a632-9674e2e16750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebc745d-af23-4967-974f-b64043105636', 'volume_name': 'volume-aebc745d-af23-4967-974f-b64043105636', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b9e3c8-1f3c-4061-bdf6-b49acfee0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b9e3c8-1f3c-4061-bdf6-b49acfee0149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d9c9eb-4b3b-4707-9f59-911ac1487049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Volume aebc745d-af23-4967-974f-b64043105636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebc745d-af23-4967-974f-b64043105636', 'volume_size': 1}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-413236864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebc745d-af23-4967-974f-b64043105636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:16Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Creating volume aebc745d-af23-4967-974f-b64043105636 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-24b8d63f-7445-4a7c-a48f-c114829e6323 req-ebcc3135-1cba-49aa-af57-218071f9a0ca tempest-AttachVolumeTestJSON-1042114128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07170e92-714a-45cd-a59b-04ee08015214', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:48:16 devstack sudo[95899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636 1073741824
Nov 05 03:48:16 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-24b8d63f-7445-4a7c-a48f-c114829e6323 req-ebcc3135-1cba-49aa-af57-218071f9a0ca tempest-AttachVolumeTestJSON-1042114128 None] attachment_update completed successfully.
Nov 05 03:48:17 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636 1073741824" returned: 0 in 1.212s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:17 devstack sudo[96321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636
Nov 05 03:48:17 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:18 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636" returned: 0 in 0.747s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d9c9eb-4b3b-4707-9f59-911ac1487049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebc745d-af23-4967-974f-b64043105636', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaedf71-5c77-43e4-9042-a982bb8103be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Volume volume-aebc745d-af23-4967-974f-b64043105636 (aebc745d-af23-4967-974f-b64043105636): created successfully
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaedf71-5c77-43e4-9042-a982bb8103be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (78d6b033-8cf6-4c41-a191-eb1df2479189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-113e02f2-543f-4c07-98ff-1fdb9aee7c1a tempest-VolumesActionsTest-1076596117 None] Created volume successfully.
Nov 05 03:48:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf1ddff7-31d7-4d03-ab67-ce1a7aa04237 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "cinder-aebc745d-af23-4967-974f-b64043105636" by "attach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf1ddff7-31d7-4d03-ab67-ce1a7aa04237 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636" acquired by "attach_volume" :: waited 0.056s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cf1ddff7-31d7-4d03-ab67-ce1a7aa04237 tempest-VolumesActionsTest-1076596117 None] Attaching volume aebc745d-af23-4967-974f-b64043105636 to instance f75f48d0-8f28-4941-8d4d-fe6c3484cea4 at mountpoint /dev/vdb on host None.
Nov 05 03:48:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cf1ddff7-31d7-4d03-ab67-ce1a7aa04237 tempest-VolumesActionsTest-1076596117 None] Attach volume completed successfully.
Nov 05 03:48:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf1ddff7-31d7-4d03-ab67-ce1a7aa04237 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636" released by "attach_volume" :: held 0.325s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-96405307-077e-4367-b83c-a82b959188f4 tempest-VolumesActionsTest-1910591940 None] Terminate volume connection completed successfully.
Nov 05 03:48:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96405307-077e-4367-b83c-a82b959188f4 tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-aebc745d-af23-4967-974f-b64043105636-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96405307-077e-4367-b83c-a82b959188f4 tempest-VolumesActionsTest-1910591940 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636-detach_volume" acquired by "detach_volume" :: waited 0.083s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-96405307-077e-4367-b83c-a82b959188f4 tempest-VolumesActionsTest-1910591940 None] Detaching volume aebc745d-af23-4967-974f-b64043105636 from instance f75f48d0-8f28-4941-8d4d-fe6c3484cea4.
Nov 05 03:48:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-96405307-077e-4367-b83c-a82b959188f4 tempest-VolumesActionsTest-1910591940 None] Detach volume completed successfully.
Nov 05 03:48:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96405307-077e-4367-b83c-a82b959188f4 tempest-VolumesActionsTest-1910591940 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636-detach_volume" released by "detach_volume" :: held 0.311s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa8aa2e7-bfe0-4566-bc90-236ea6bf4b29 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "cinder-aebc745d-af23-4967-974f-b64043105636-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa8aa2e7-bfe0-4566-bc90-236ea6bf4b29 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-aa8aa2e7-bfe0-4566-bc90-236ea6bf4b29 tempest-VolumesActionsTest-1076596117 None] Volume detach called, but volume not attached.
Nov 05 03:48:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aa8aa2e7-bfe0-4566-bc90-236ea6bf4b29 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Acquiring lock "cinder-aebc745d-af23-4967-974f-b64043105636-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Acquiring lock "cinder-quobyte-aebc745d-af23-4967-974f-b64043105636" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Lock "cinder-quobyte-aebc745d-af23-4967-974f-b64043105636" acquired by "delete_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b131530e-f071-4886-a08d-6c3143a6240f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:23 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636
Nov 05 03:48:23 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:25 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636" returned: 0 in 1.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:25 devstack sudo[96404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636
Nov 05 03:48:25 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:25 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-aebc745d-af23-4967-974f-b64043105636" returned: 0 in 0.572s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Lock "cinder-quobyte-aebc745d-af23-4967-974f-b64043105636" released by "delete_volume" :: held 2.277s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:25 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=53,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:48:25 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Created reservations ['b565cc50-9d97-408c-b303-9c715901b245', '0a34d635-2aba-44e6-9c3c-549042f1b581', 'd6dd46cc-0b0b-4209-bf81-dce17945cf6b', 'f2b2f469-7072-4e4a-8e49-37895bb66fbe'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:26 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:26 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:26 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.546s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Deleted volume successfully.
Nov 05 03:48:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a5836de-c988-4040-9225-8673aedb0cae tempest-VolumesActionsTest-1076596117 None] Lock "cinder-aebc745d-af23-4967-974f-b64043105636-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (a488ead7-cc62-4ba4-9f24-8b3929139238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca68c5e-1545-4c47-bd89-46b61a41d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca68c5e-1545-4c47-bd89-46b61a41d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89055599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbf70c7-05cf-43eb-9040-33f37aad2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:34Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10dcd76-5060-4a6d-a9cd-bd0c185ade7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10dcd76-5060-4a6d-a9cd-bd0c185ade7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71322291-6f23-4575-989b-28b48947505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71322291-6f23-4575-989b-28b48947505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbf70c7-05cf-43eb-9040-33f37aad2578', 'volume_name': 'volume-ecbf70c7-05cf-43eb-9040-33f37aad2578', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b07aa46-cccf-45f2-81b7-56b89c89eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b07aa46-cccf-45f2-81b7-56b89c89eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba267d87-4186-4e1c-b3f1-22dc089ab851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Volume ecbf70c7-05cf-43eb-9040-33f37aad2578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbf70c7-05cf-43eb-9040-33f37aad2578', 'volume_size': 1}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89055599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbf70c7-05cf-43eb-9040-33f37aad2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:34Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Creating volume ecbf70c7-05cf-43eb-9040-33f37aad2578 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:33 devstack sudo[96984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 1073741824
Nov 05 03:48:33 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:34 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 1073741824" returned: 0 in 0.581s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:34 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578
Nov 05 03:48:34 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:34 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba267d87-4186-4e1c-b3f1-22dc089ab851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbf70c7-05cf-43eb-9040-33f37aad2578', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9302b2fe-01ba-4070-90bc-eee06acdecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Volume volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 (ecbf70c7-05cf-43eb-9040-33f37aad2578): created successfully
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9302b2fe-01ba-4070-90bc-eee06acdecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (a488ead7-cc62-4ba4-9f24-8b3929139238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-027c39e7-f8a8-4121-8a28-d9178946ec78 tempest-VolumesActionsTest-1076596117 None] Created volume successfully.
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-ecbf70c7-05cf-43eb-9040-33f37aad2578-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Lock "cinder-ecbf70c7-05cf-43eb-9040-33f37aad2578-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-quobyte-ecbf70c7-05cf-43eb-9040-33f37aad2578" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-ecbf70c7-05cf-43eb-9040-33f37aad2578" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[369baadc-e436-46a6-a413-f806875b0663]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:36 devstack sudo[96994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578
Nov 05 03:48:36 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:36 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:36 devstack sudo[97000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578
Nov 05 03:48:36 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:37 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecbf70c7-05cf-43eb-9040-33f37aad2578" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-ecbf70c7-05cf-43eb-9040-33f37aad2578" released by "delete_volume" :: held 0.925s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Created reservations ['cb644034-8e51-4c3d-9c1c-c3481a77803d', 'c3363642-178f-41d9-ba94-96a993cb4dd9', 'a0a7609d-d871-4489-999c-ce0ee2379d54', '4236ed3b-5d45-451d-976d-f29dcf9c357e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:37 devstack sudo[97003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:37 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:37 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Deleted volume successfully.
Nov 05 03:48:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-057eebf7-8db2-429b-aed5-5386bd1cdeed tempest-VolumesActionsTest-1910591940 None] Lock "cinder-ecbf70c7-05cf-43eb-9040-33f37aad2578-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Flow 'volume_create_manager' (91188fd2-b6ce-4959-9c34-a281f16c411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd86bdc-bfc8-4521-9c56-81b70cd6e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd86bdc-bfc8-4521-9c56-81b70cd6e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1234194454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cda6df-3755-4c70-b01c-a27bcfe7e9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca246784fbf54ea9b692ff94eb8d2e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:39Z,use_quota=True,user_id='c081c78eda7444d9bd1d02a6c920a2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00372518-51c7-4c63-ae53-081bd715f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00372518-51c7-4c63-ae53-081bd715f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14761c-2f85-4c0b-8227-bd30de7ef34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14761c-2f85-4c0b-8227-bd30de7ef34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cda6df-3755-4c70-b01c-a27bcfe7e9a5', 'volume_name': 'volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03882dbf-7faa-4146-8ef7-25062d77d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03882dbf-7faa-4146-8ef7-25062d77d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a23cd-73e1-4446-93fa-4b6029a4ba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Volume 33cda6df-3755-4c70-b01c-a27bcfe7e9a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5', 'volume_size': 1}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1234194454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cda6df-3755-4c70-b01c-a27bcfe7e9a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca246784fbf54ea9b692ff94eb8d2e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:39Z,use_quota=True,user_id='c081c78eda7444d9bd1d02a6c920a2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Creating volume 33cda6df-3755-4c70-b01c-a27bcfe7e9a5 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:39 devstack sudo[97008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 1073741824
Nov 05 03:48:39 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (c4c605aa-4f21-4f92-99da-04eb751a7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1fadc2-9fd9-4143-9298-739397bd0473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1fadc2-9fd9-4143-9298-739397bd0473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-497754029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2b81b6-17c2-46ac-9745-1e6273906551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:40Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971c1b54-1342-4b8b-b02f-7b11c0182dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971c1b54-1342-4b8b-b02f-7b11c0182dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ce959a-4b60-45fd-a530-105883b2db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ce959a-4b60-45fd-a530-105883b2db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2b81b6-17c2-46ac-9745-1e6273906551', 'volume_name': 'volume-2b2b81b6-17c2-46ac-9745-1e6273906551', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a512ed-6d91-4d0a-96a7-073f330392aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a512ed-6d91-4d0a-96a7-073f330392aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7479e57e-54f0-43bf-9402-49e521a5282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Volume 2b2b81b6-17c2-46ac-9745-1e6273906551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2b81b6-17c2-46ac-9745-1e6273906551', 'volume_size': 1}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:39 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 1073741824" returned: 0 in 0.766s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:39 devstack sudo[97014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5
Nov 05 03:48:39 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:40 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5" returned: 0 in 0.315s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-497754029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2b81b6-17c2-46ac-9745-1e6273906551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:40Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Creating volume 2b2b81b6-17c2-46ac-9745-1e6273906551 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:40 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:40 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551 1073741824
Nov 05 03:48:40 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730a23cd-73e1-4446-93fa-4b6029a4ba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3feb78d-95d5-41c2-a479-1aa7eed78f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Volume volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 (33cda6df-3755-4c70-b01c-a27bcfe7e9a5): created successfully
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3feb78d-95d5-41c2-a479-1aa7eed78f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Flow 'volume_create_manager' (91188fd2-b6ce-4959-9c34-a281f16c411f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-105b918c-1a63-4fd1-8f7f-5189e721b0a9 tempest-AttachVolumeNegativeTest-1809005525 None] Created volume successfully.
Nov 05 03:48:40 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551 1073741824" returned: 0 in 0.665s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:41 devstack sudo[97025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551
Nov 05 03:48:41 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:41 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551" returned: 0 in 0.505s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7479e57e-54f0-43bf-9402-49e521a5282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2b81b6-17c2-46ac-9745-1e6273906551', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956f0083-3676-4d6e-ba41-aded5a8106ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Volume volume-2b2b81b6-17c2-46ac-9745-1e6273906551 (2b2b81b6-17c2-46ac-9745-1e6273906551): created successfully
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956f0083-3676-4d6e-ba41-aded5a8106ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (c4c605aa-4f21-4f92-99da-04eb751a7abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c9da8d83-6402-419e-b6a7-9e167dd95f88 tempest-VolumesActionsTest-1076596117 None] Created volume successfully.
Nov 05 03:48:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-71ed86d5-b903-4b47-8a59-92eac72164c6 req-acc0ab8b-d4fd-461c-a3d0-d0dc2dc9d005 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-71ed86d5-b903-4b47-8a59-92eac72164c6 req-acc0ab8b-d4fd-461c-a3d0-d0dc2dc9d005 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-71ed86d5-b903-4b47-8a59-92eac72164c6 req-acc0ab8b-d4fd-461c-a3d0-d0dc2dc9d005 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-71ed86d5-b903-4b47-8a59-92eac72164c6 req-acc0ab8b-d4fd-461c-a3d0-d0dc2dc9d005 tempest-AttachVolumeNegativeTest-1809005525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b04e10f4-d5e8-4a5e-8586-2e8bf1302289', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:48:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-71ed86d5-b903-4b47-8a59-92eac72164c6 req-acc0ab8b-d4fd-461c-a3d0-d0dc2dc9d005 tempest-AttachVolumeNegativeTest-1809005525 None] attachment_update completed successfully.
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-2b2b81b6-17c2-46ac-9745-1e6273906551-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Lock "cinder-2b2b81b6-17c2-46ac-9745-1e6273906551-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-quobyte-2b2b81b6-17c2-46ac-9745-1e6273906551" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-2b2b81b6-17c2-46ac-9745-1e6273906551" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[30250edc-8c59-4b2c-ab2c-c4002da3fc82]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:43 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551
Nov 05 03:48:43 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:43 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551" returned: 0 in 0.524s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:43 devstack sudo[97051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551
Nov 05 03:48:43 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:44 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2b2b81b6-17c2-46ac-9745-1e6273906551" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-2b2b81b6-17c2-46ac-9745-1e6273906551" released by "delete_volume" :: held 1.007s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Created reservations ['e6316e0b-9736-4ae6-83a8-116ff5165ed5', 'ad5ecd9b-f634-443c-b5c3-b33bb9ce73f1', '570d8fcc-91ba-421b-9432-9d708d9eb656', 'ce8496c4-1619-49c5-b150-de781fbadf1c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:44 devstack sudo[97058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:44 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:44 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:44 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Deleted volume successfully.
Nov 05 03:48:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7e20d3c7-fdb8-4798-8420-c3d6736fc8ea tempest-VolumesActionsTest-1910591940 None] Lock "cinder-2b2b81b6-17c2-46ac-9745-1e6273906551-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-74c17ca2-5aaa-43f8-9ba3-1db97fd09287 req-ba2cf4a5-8a63-4506-8d6f-e484573fdaed tempest-AttachVolumeNegativeTest-1809005525 None] Terminate volume connection completed successfully.
Nov 05 03:48:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-74c17ca2-5aaa-43f8-9ba3-1db97fd09287 req-ba2cf4a5-8a63-4506-8d6f-e484573fdaed tempest-AttachVolumeNegativeTest-1809005525 None] Deleting attachment b04e10f4-d5e8-4a5e-8586-2e8bf1302289. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (c03909b6-10dc-48a1-b5c5-2099b27cef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce9657b-53a7-4511-8f40-e78a48ebf64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce9657b-53a7-4511-8f40-e78a48ebf64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331788197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72bf406-059e-4266-88de-7c0e2850dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:46Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02826b76-487d-4970-a852-a601a9ef33ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02826b76-487d-4970-a852-a601a9ef33ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580a20c-7b1b-4c42-a88d-486c237eb1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580a20c-7b1b-4c42-a88d-486c237eb1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd72bf406-059e-4266-88de-7c0e2850dfed', 'volume_name': 'volume-d72bf406-059e-4266-88de-7c0e2850dfed', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2387d791-7324-4022-9334-c43a4130be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2387d791-7324-4022-9334-c43a4130be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d067a292-a65d-4046-bba7-0f4f81f4aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Volume d72bf406-059e-4266-88de-7c0e2850dfed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d72bf406-059e-4266-88de-7c0e2850dfed', 'volume_size': 1}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331788197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72bf406-059e-4266-88de-7c0e2850dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:46Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Creating volume d72bf406-059e-4266-88de-7c0e2850dfed {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:46 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:46 devstack sudo[97087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed 1073741824
Nov 05 03:48:46 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:46 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed 1073741824" returned: 0 in 0.763s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:47 devstack sudo[97114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed
Nov 05 03:48:47 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:47 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d067a292-a65d-4046-bba7-0f4f81f4aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72bf406-059e-4266-88de-7c0e2850dfed', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10420c15-553e-4995-9e61-fd1318f97cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Volume volume-d72bf406-059e-4266-88de-7c0e2850dfed (d72bf406-059e-4266-88de-7c0e2850dfed): created successfully
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10420c15-553e-4995-9e61-fd1318f97cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (c03909b6-10dc-48a1-b5c5-2099b27cef8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-73f77089-ffae-4487-a15c-2660a34e4fcb tempest-VolumesActionsTest-1076596117 None] Created volume successfully.
Nov 05 03:48:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-d72bf406-059e-4266-88de-7c0e2850dfed-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Lock "cinder-d72bf406-059e-4266-88de-7c0e2850dfed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-quobyte-d72bf406-059e-4266-88de-7c0e2850dfed" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-d72bf406-059e-4266-88de-7c0e2850dfed" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e4cf44-0d76-4fd3-92d9-94ec6810bf6e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:48 devstack sudo[97120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed
Nov 05 03:48:48 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:49 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:49 devstack sudo[97126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed
Nov 05 03:48:49 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:49 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d72bf406-059e-4266-88de-7c0e2850dfed" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-d72bf406-059e-4266-88de-7c0e2850dfed" released by "delete_volume" :: held 0.885s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Created reservations ['0235ee0e-fa1b-4907-9cb0-bc7b9ea6f9b3', '7aec32bf-5c61-49ca-97e4-575de28d5c0d', '4297be40-bddb-4b42-9f41-7e0e498e4aee', '9ab151db-cbe6-414f-a6e7-bfcb83b1ceb9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:49 devstack sudo[97129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:49 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:50 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Deleted volume successfully.
Nov 05 03:48:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d975018e-9f92-4178-8076-898a79e0b27c tempest-VolumesActionsTest-1910591940 None] Lock "cinder-d72bf406-059e-4266-88de-7c0e2850dfed-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (4b4ba3c1-fecd-429d-8e72-fd7b121b3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23c20d-fde3-47c8-a6b4-550865d6e2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23c20d-fde3-47c8-a6b4-550865d6e2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-219180704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766af1b1-995b-4d77-8644-0076a59c1690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:52Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8557907a-74fb-4dc5-b240-be6d5332a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8557907a-74fb-4dc5-b240-be6d5332a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa2a808-c8e1-46c7-9eac-f07988109057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa2a808-c8e1-46c7-9eac-f07988109057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766af1b1-995b-4d77-8644-0076a59c1690', 'volume_name': 'volume-766af1b1-995b-4d77-8644-0076a59c1690', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af7f43c-98eb-44c0-9336-569fa9fbf38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af7f43c-98eb-44c0-9336-569fa9fbf38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401838e1-222d-4e83-b01c-50593907abb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Volume 766af1b1-995b-4d77-8644-0076a59c1690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766af1b1-995b-4d77-8644-0076a59c1690', 'volume_size': 1}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-219180704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766af1b1-995b-4d77-8644-0076a59c1690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:52Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Creating volume 766af1b1-995b-4d77-8644-0076a59c1690 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:51 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:51 devstack sudo[97170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690 1073741824
Nov 05 03:48:51 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:52 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690 1073741824" returned: 0 in 0.746s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:52 devstack sudo[97176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690
Nov 05 03:48:52 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:53 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690" returned: 0 in 0.381s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401838e1-222d-4e83-b01c-50593907abb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766af1b1-995b-4d77-8644-0076a59c1690', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0d9212-8fa1-46c7-b221-1e2989a1032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Volume volume-766af1b1-995b-4d77-8644-0076a59c1690 (766af1b1-995b-4d77-8644-0076a59c1690): created successfully
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0d9212-8fa1-46c7-b221-1e2989a1032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (4b4ba3c1-fecd-429d-8e72-fd7b121b3074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7e99353b-7f18-430a-b43f-30ef1c993da1 tempest-VolumesActionsTest-1076596117 None] Created volume successfully.
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-766af1b1-995b-4d77-8644-0076a59c1690-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Lock "cinder-766af1b1-995b-4d77-8644-0076a59c1690-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Acquiring lock "cinder-quobyte-766af1b1-995b-4d77-8644-0076a59c1690" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-766af1b1-995b-4d77-8644-0076a59c1690" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbdecdf-0bf1-489e-b617-7e775866f2ee]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:54 devstack sudo[97179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690
Nov 05 03:48:54 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:54 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:54 devstack sudo[97187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690
Nov 05 03:48:54 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:55 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-766af1b1-995b-4d77-8644-0076a59c1690" returned: 0 in 0.484s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Lock "cinder-quobyte-766af1b1-995b-4d77-8644-0076a59c1690" released by "delete_volume" :: held 1.052s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Created reservations ['24e953a5-8b45-4e1e-9408-e3dac51d1eb3', 'da34c5d9-0db0-4e47-b63e-7fda5342efc8', '4364ba4d-2c3d-4a44-835f-66d40035669b', 'f214001c-1741-4e03-bf9e-9ac97a7d9fa0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:55 devstack sudo[97190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:48:55 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-28186194-db7e-4588-9459-f00ac63b231b req-2dc2c89a-926a-4361-b832-836867266763 tempest-AttachVolumeTestJSON-1042114128 None] Terminate volume connection completed successfully.
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-28186194-db7e-4588-9459-f00ac63b231b req-2dc2c89a-926a-4361-b832-836867266763 tempest-AttachVolumeTestJSON-1042114128 None] Deleting attachment 07170e92-714a-45cd-a59b-04ee08015214. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:48:55 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:55 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:48:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Deleted volume successfully.
Nov 05 03:48:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01335b26-f553-4346-ac18-f7bb4864fed3 tempest-VolumesActionsTest-1910591940 None] Lock "cinder-766af1b1-995b-4d77-8644-0076a59c1690-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (92a3afca-31a1-4863-ba49-5c6d227c02c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aadc02a-4914-4719-9b47-dff990d7d0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aadc02a-4914-4719-9b47-dff990d7d0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1106788366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0fd3d-802b-4608-9d85-0bb32b8b1d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:57Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2419855-8a38-4002-bf77-c90540f6dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2419855-8a38-4002-bf77-c90540f6dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc35f79b-952c-4f68-9b7f-a7ccb9e7d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc35f79b-952c-4f68-9b7f-a7ccb9e7d19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a0fd3d-802b-4608-9d85-0bb32b8b1d10', 'volume_name': 'volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4cc173-9f08-49e5-a6dc-b6defca8c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4cc173-9f08-49e5-a6dc-b6defca8c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a785b20b-cd27-4999-b28a-c2fd64869350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Volume 81a0fd3d-802b-4608-9d85-0bb32b8b1d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10', 'volume_size': 1}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1106788366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0fd3d-802b-4608-9d85-0bb32b8b1d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e851ae22a440f08f10829b04e4474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:57Z,use_quota=True,user_id='33d4bc565ec54e10ba6a455d6b78c31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Creating volume 81a0fd3d-802b-4608-9d85-0bb32b8b1d10 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:48:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:48:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:57 devstack sudo[97201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 1073741824
Nov 05 03:48:57 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:58 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 1073741824" returned: 0 in 0.748s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:48:58 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10
Nov 05 03:48:58 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:48:58 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a785b20b-cd27-4999-b28a-c2fd64869350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a014ec6-46e7-4375-8bea-41722ddce86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:48:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Volume volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 (81a0fd3d-802b-4608-9d85-0bb32b8b1d10): created successfully
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a014ec6-46e7-4375-8bea-41722ddce86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:48:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Flow 'volume_create_manager' (92a3afca-31a1-4863-ba49-5c6d227c02c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:48:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-87ab9419-042c-4358-98b3-506f7c23638a tempest-VolumesActionsTest-1076596117 None] Created volume successfully.
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "cinder-81a0fd3d-802b-4608-9d85-0bb32b8b1d10-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-81a0fd3d-802b-4608-9d85-0bb32b8b1d10-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=73,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "cinder-quobyte-81a0fd3d-802b-4608-9d85-0bb32b8b1d10" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-quobyte-81a0fd3d-802b-4608-9d85-0bb32b8b1d10" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad71bbda-6d15-48f5-a411-6d5ce3cef61a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:00 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10
Nov 05 03:49:00 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:01 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10" returned: 0 in 0.631s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:01 devstack sudo[97218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10
Nov 05 03:49:01 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:01 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-81a0fd3d-802b-4608-9d85-0bb32b8b1d10" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-quobyte-81a0fd3d-802b-4608-9d85-0bb32b8b1d10" released by "delete_volume" :: held 1.239s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Created reservations ['591a3fb6-a920-4ad5-b801-23d352d7e181', '43e0d3b1-20b3-414b-8adb-2462b7d7ca3b', 'f91f3e7f-9981-4b9d-9e89-3c83635f8205', '459ed37d-7fe0-43a6-ac25-a91962d46c6e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:02 devstack sudo[97221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:49:02 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:02 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Deleted volume successfully.
Nov 05 03:49:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7126485d-cf90-4aa4-9968-fd75a0246e62 tempest-VolumesActionsTest-1076596117 None] Lock "cinder-81a0fd3d-802b-4608-9d85-0bb32b8b1d10-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Flow 'volume_create_manager' (ca372597-1cd8-47c9-9a48-a26a4eee4880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16cd362-20b3-4790-8f31-548a308d5a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16cd362-20b3-4790-8f31-548a308d5a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1979125829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d9c68c-7327-40e3-9726-1c40619d1483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8343993c814b2f950e7a7ce1f5fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:05Z,use_quota=True,user_id='1b5dd4c29a0b48e58cf5a182f2cc7042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3614245f-709a-4626-95f6-3782c3714870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3614245f-709a-4626-95f6-3782c3714870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6148fb8f-f5db-4c0a-8041-58fa27dfb02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6148fb8f-f5db-4c0a-8041-58fa27dfb02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d9c68c-7327-40e3-9726-1c40619d1483', 'volume_name': 'volume-d7d9c68c-7327-40e3-9726-1c40619d1483', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ddf987-ec58-4262-96c7-8483e3045bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ddf987-ec58-4262-96c7-8483e3045bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d976f74-28d1-4380-846e-94b289741037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Volume d7d9c68c-7327-40e3-9726-1c40619d1483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d9c68c-7327-40e3-9726-1c40619d1483', 'volume_size': 1}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1979125829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d9c68c-7327-40e3-9726-1c40619d1483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8343993c814b2f950e7a7ce1f5fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:05Z,use_quota=True,user_id='1b5dd4c29a0b48e58cf5a182f2cc7042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Creating volume d7d9c68c-7327-40e3-9726-1c40619d1483 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:49:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:04 devstack sudo[97303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483 1073741824
Nov 05 03:49:04 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483 1073741824" returned: 0 in 1.199s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Flow 'volume_create_manager' (6635a836-9dae-444a-a57e-17aa4634b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874d0193-0f74-47ad-876d-37a94efd4936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874d0193-0f74-47ad-876d-37a94efd4936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2116449824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eded58a3-29fd-4e6d-b680-77dd8077306a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8343993c814b2f950e7a7ce1f5fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:06Z,use_quota=True,user_id='1b5dd4c29a0b48e58cf5a182f2cc7042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a2d2a-b045-4a91-8d52-174cfe277148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a2d2a-b045-4a91-8d52-174cfe277148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986211d1-213e-4865-8299-ebfb9b65e060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986211d1-213e-4865-8299-ebfb9b65e060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eded58a3-29fd-4e6d-b680-77dd8077306a', 'volume_name': 'volume-eded58a3-29fd-4e6d-b680-77dd8077306a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc810b9-c3b6-419c-b1da-d0cf58ce3b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc810b9-c3b6-419c-b1da-d0cf58ce3b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1560fbfa-5f94-4621-a6c7-aa0c4d783f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Volume eded58a3-29fd-4e6d-b680-77dd8077306a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eded58a3-29fd-4e6d-b680-77dd8077306a', 'volume_size': 1}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack sudo[97354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483
Nov 05 03:49:06 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483" returned: 0 in 0.556s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2116449824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eded58a3-29fd-4e6d-b680-77dd8077306a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8343993c814b2f950e7a7ce1f5fa7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:06Z,use_quota=True,user_id='1b5dd4c29a0b48e58cf5a182f2cc7042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Creating volume eded58a3-29fd-4e6d-b680-77dd8077306a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:06 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d976f74-28d1-4380-846e-94b289741037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d9c68c-7327-40e3-9726-1c40619d1483', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:06 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a 1073741824
Nov 05 03:49:06 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65e92c6-74b2-4992-b6f5-b67d3790becb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Volume volume-d7d9c68c-7327-40e3-9726-1c40619d1483 (d7d9c68c-7327-40e3-9726-1c40619d1483): created successfully
Nov 05 03:49:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65e92c6-74b2-4992-b6f5-b67d3790becb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Flow 'volume_create_manager' (ca372597-1cd8-47c9-9a48-a26a4eee4880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-521565c1-5a4b-4a30-99c0-e6ab3a7f9aec tempest-TestServerVolumeAttachmentScenario-2104288510 None] Created volume successfully.
Nov 05 03:49:07 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a 1073741824" returned: 0 in 0.942s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:07 devstack sudo[97369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a
Nov 05 03:49:07 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:08 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a" returned: 0 in 0.497s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1560fbfa-5f94-4621-a6c7-aa0c4d783f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eded58a3-29fd-4e6d-b680-77dd8077306a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2856b4fb-be49-4931-b444-3cbd080f0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:08 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Volume volume-eded58a3-29fd-4e6d-b680-77dd8077306a (eded58a3-29fd-4e6d-b680-77dd8077306a): created successfully
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2856b4fb-be49-4931-b444-3cbd080f0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Flow 'volume_create_manager' (6635a836-9dae-444a-a57e-17aa4634b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3cc329f2-6308-4131-be01-a3b69ff2793a tempest-TestServerVolumeAttachmentScenario-2104288510 None] Created volume successfully.
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:08 devstack sudo[97373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:49:08 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:09 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:49:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:49:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:49:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=64,cinder:UPDATE=73,cinder:DELETE=8,cinder:INSERT=11 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:49:24 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Flow 'volume_create_manager' (a6db13dc-c5b6-45fd-b3d3-854fa4a7dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc4565a-deee-403d-8b79-6062b729e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc4565a-deee-403d-8b79-6062b729e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1586364754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456c17b4-9bc9-43e1-a34b-1b350111061e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d1b1b60444325a381aa0d5f2a138f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:33Z,use_quota=True,user_id='fd281e575765432c95962590f136aad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b5fc3c-bb9b-4d8b-8d60-a17cb6e3a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b5fc3c-bb9b-4d8b-8d60-a17cb6e3a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeb4173-1d9d-4d05-b299-51be56459cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:32 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:49:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeb4173-1d9d-4d05-b299-51be56459cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '456c17b4-9bc9-43e1-a34b-1b350111061e', 'volume_name': 'volume-456c17b4-9bc9-43e1-a34b-1b350111061e', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7353987d0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353348e6-a9b3-44e2-965e-1e313e9dedf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353348e6-a9b3-44e2-965e-1e313e9dedf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f310b75f-8c66-40af-9566-9f8fe3a181e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Volume 456c17b4-9bc9-43e1-a34b-1b350111061e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-456c17b4-9bc9-43e1-a34b-1b350111061e', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7353987d0>}
Nov 05 03:49:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Trying to clone 456c17b4-9bc9-43e1-a34b-1b350111061e from image b168d99d-9565-4249-9e41-af4fab9708fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:49:34 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:49:34 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:49:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2db476-4371-43d3-ba9a-a2084e25c2a3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:34 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD
Nov 05 03:49:34 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:34 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD" returned: 0 in 0.671s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:34 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb is fetched for user fd281e575765432c95962590f136aad4. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b426ad2-a79c-4619-9145-d7c0828d71b8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:35 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD
Nov 05 03:49:35 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:35 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1586364754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456c17b4-9bc9-43e1-a34b-1b350111061e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d1b1b60444325a381aa0d5f2a138f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:33Z,use_quota=True,user_id='fd281e575765432c95962590f136aad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Creating volume 456c17b4-9bc9-43e1-a34b-1b350111061e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:49:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:35 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e 1073741824
Nov 05 03:49:35 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:36 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e 1073741824" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:36 devstack sudo[97644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e
Nov 05 03:49:36 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:36 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Attempting download of b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume 456c17b4-9bc9-43e1-a34b-1b350111061e. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f152b2-ba64-4e59-918d-8f22b9fb7e74]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:36 devstack sudo[97649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg
Nov 05 03:49:36 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:37 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg" returned: 0 in 0.743s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:37 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg
Nov 05 03:49:37 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:37 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg" returned: 1 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_2l39g8jg' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:49:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a4c5f7-bcb1-4a75-b0a0-61ff42964169]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:37 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD
Nov 05 03:49:37 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:38 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:38 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] b168d99d-9565-4249-9e41-af4fab9708fb was qcow2, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:49:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:38 devstack sudo[97663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e
Nov 05 03:49:38 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:41 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e" returned: 0 in 2.877s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_1ly75y92devstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:49:41 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Converted 112.00 MB image at 38.92 MB/s
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:41 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e 1G
Nov 05 03:49:41 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:41 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e 1G" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Downloaded image b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume 456c17b4-9bc9-43e1-a34b-1b350111061e successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb for user fd281e575765432c95962590f136aad4 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Marking volume 456c17b4-9bc9-43e1-a34b-1b350111061e as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Copying metadata from image b168d99d-9565-4249-9e41-af4fab9708fb to 456c17b4-9bc9-43e1-a34b-1b350111061e. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Creating volume glance metadata for volume 456c17b4-9bc9-43e1-a34b-1b350111061e backed by image b168d99d-9565-4249-9e41-af4fab9708fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f310b75f-8c66-40af-9566-9f8fe3a181e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456c17b4-9bc9-43e1-a34b-1b350111061e', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7353987d0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0436d1cd-924f-48cf-90b3-412a6f441595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Volume volume-456c17b4-9bc9-43e1-a34b-1b350111061e (456c17b4-9bc9-43e1-a34b-1b350111061e): created successfully
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0436d1cd-924f-48cf-90b3-412a6f441595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Flow 'volume_create_manager' (a6db13dc-c5b6-45fd-b3d3-854fa4a7dd82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-44688676-e048-4281-be0a-ed3b8b298fab tempest-VolumesImageMetadata-569182538 None] Created volume successfully.
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Acquiring lock "cinder-456c17b4-9bc9-43e1-a34b-1b350111061e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Lock "cinder-456c17b4-9bc9-43e1-a34b-1b350111061e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Flow 'volume_create_manager' (eff6c99f-4695-491d-9f3d-436ba573f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83183544-3608-4758-b85f-3a32b949eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83183544-3608-4758-b85f-3a32b949eed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2029080762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36c811b-88ca-4fa9-bff2-46b4c42a5b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca246784fbf54ea9b692ff94eb8d2e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:44Z,use_quota=True,user_id='c081c78eda7444d9bd1d02a6c920a2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a26b2a1-2eb2-4c0f-9f8d-5e9e3b00f8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a26b2a1-2eb2-4c0f-9f8d-5e9e3b00f8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb00317-eac9-4c90-b455-b7eedee85e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb00317-eac9-4c90-b455-b7eedee85e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36c811b-88ca-4fa9-bff2-46b4c42a5b75', 'volume_name': 'volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a28f13-fb78-477b-82c1-a0a9414ea902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a28f13-fb78-477b-82c1-a0a9414ea902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11c621d-4be1-4645-968d-533a2ba852e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Volume d36c811b-88ca-4fa9-bff2-46b4c42a5b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75', 'volume_size': 1}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2029080762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36c811b-88ca-4fa9-bff2-46b4c42a5b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca246784fbf54ea9b692ff94eb8d2e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:44Z,use_quota=True,user_id='c081c78eda7444d9bd1d02a6c920a2b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Creating volume d36c811b-88ca-4fa9-bff2-46b4c42a5b75 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:49:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Acquiring lock "cinder-quobyte-456c17b4-9bc9-43e1-a34b-1b350111061e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:43 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 1073741824
Nov 05 03:49:43 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Lock "cinder-quobyte-456c17b4-9bc9-43e1-a34b-1b350111061e" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeff93d-3428-448b-9373-a22495c5b060]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:43 devstack sudo[97711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e
Nov 05 03:49:43 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:44 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e" returned: 0 in 0.457s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:44 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 1073741824" returned: 0 in 0.568s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e
Nov 05 03:49:44 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:44 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75
Nov 05 03:49:44 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:44 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-456c17b4-9bc9-43e1-a34b-1b350111061e" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Lock "cinder-quobyte-456c17b4-9bc9-43e1-a34b-1b350111061e" released by "delete_volume" :: held 0.887s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:44 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75" returned: 0 in 0.381s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Created reservations ['3fdbf8de-9a05-41ac-84ae-76c9a698212c', '431143f6-8dd6-42fd-8137-42562f319262', '5e41a735-5569-4bab-91f8-85b1adbc9bd2', '524d5ee5-11ed-49f9-a5c7-947ee41a4785'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11c621d-4be1-4645-968d-533a2ba852e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453820f7-935d-44ae-9486-5abc09886c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:49:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Volume volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 (d36c811b-88ca-4fa9-bff2-46b4c42a5b75): created successfully
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453820f7-935d-44ae-9486-5abc09886c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Flow 'volume_create_manager' (eff6c99f-4695-491d-9f3d-436ba573f624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:49:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5becda5f-3c52-4902-be98-b777c48c20b4 tempest-AttachVolumeNegativeTest-1809005525 None] Created volume successfully.
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:44 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:49:44 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:49:45 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Nov 05 03:49:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:49:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:49:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Deleted volume successfully.
Nov 05 03:49:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9735245a-eae4-4718-98d2-00653865948a tempest-VolumesImageMetadata-569182538 None] Lock "cinder-456c17b4-9bc9-43e1-a34b-1b350111061e-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:49:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-739faf6e-3608-4b26-bf85-3e39465e8d85 req-94fd9c92-f90d-4835-802b-945820c0eea4 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-739faf6e-3608-4b26-bf85-3e39465e8d85 req-94fd9c92-f90d-4835-802b-945820c0eea4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-739faf6e-3608-4b26-bf85-3e39465e8d85 req-94fd9c92-f90d-4835-802b-945820c0eea4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-739faf6e-3608-4b26-bf85-3e39465e8d85 req-94fd9c92-f90d-4835-802b-945820c0eea4 tempest-AttachVolumeNegativeTest-1809005525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f980e7d5-fc2d-4694-b34e-e8090773e147', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:49:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-739faf6e-3608-4b26-bf85-3e39465e8d85 req-94fd9c92-f90d-4835-802b-945820c0eea4 tempest-AttachVolumeNegativeTest-1809005525 None] attachment_update completed successfully.
Nov 05 03:49:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-b8f3d975-bdfe-42f0-859a-e57ee1a7a902 req-eb342280-40aa-44b9-be5e-06399c0365c5 tempest-AttachVolumeNegativeTest-1809005525 None] Terminate volume connection completed successfully.
Nov 05 03:49:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-b8f3d975-bdfe-42f0-859a-e57ee1a7a902 req-eb342280-40aa-44b9-be5e-06399c0365c5 tempest-AttachVolumeNegativeTest-1809005525 None] Deleting attachment f980e7d5-fc2d-4694-b34e-e8090773e147. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:49:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5bd0d962-27ab-4515-9008-d599f87400e8 req-bc92f148-8973-4259-93f4-0f0602f9d795 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:49:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5bd0d962-27ab-4515-9008-d599f87400e8 req-bc92f148-8973-4259-93f4-0f0602f9d795 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:49:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-5bd0d962-27ab-4515-9008-d599f87400e8 req-bc92f148-8973-4259-93f4-0f0602f9d795 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:49:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-5bd0d962-27ab-4515-9008-d599f87400e8 req-bc92f148-8973-4259-93f4-0f0602f9d795 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-d7d9c68c-7327-40e3-9726-1c40619d1483', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38ef7a16-44de-4f7d-9e56-74a6dc910071', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:49:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-5bd0d962-27ab-4515-9008-d599f87400e8 req-bc92f148-8973-4259-93f4-0f0602f9d795 tempest-TestServerVolumeAttachmentScenario-2104288510 None] attachment_update completed successfully.
Nov 05 03:49:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "cinder-d36c811b-88ca-4fa9-bff2-46b4c42a5b75-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-d36c811b-88ca-4fa9-bff2-46b4c42a5b75-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "cinder-quobyte-d36c811b-88ca-4fa9-bff2-46b4c42a5b75" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:49:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-quobyte-d36c811b-88ca-4fa9-bff2-46b4c42a5b75" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:49:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f553384-4b27-4d63-ac5f-4704e04b75eb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:49:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:49:59 devstack sudo[98766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75
Nov 05 03:49:59 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:00 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75" returned: 0 in 0.763s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:00 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75
Nov 05 03:50:00 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Flow 'volume_create_manager' (86ba04c4-e872-40c5-9184-3a0610f73c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:00 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98179c5e-f665-43f5-b76c-8cb148863e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d36c811b-88ca-4fa9-bff2-46b4c42a5b75" returned: 0 in 0.724s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98179c5e-f665-43f5-b76c-8cb148863e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1627328192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb151f8-7c16-432e-be77-63651201f121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee3c3d08b5b4494a5c9cc2c2379bbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:01Z,use_quota=True,user_id='b537c4011556432c9a3cd6b6ae7981de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5301cb4-d851-4f2a-862e-4f27dd2cc899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5301cb4-d851-4f2a-862e-4f27dd2cc899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa09ac5-da41-4c18-854a-d919031c5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa09ac5-da41-4c18-854a-d919031c5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb151f8-7c16-432e-be77-63651201f121', 'volume_name': 'volume-ceb151f8-7c16-432e-be77-63651201f121', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b088ff-4cf7-46c7-9d3c-f9a0769f2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b088ff-4cf7-46c7-9d3c-f9a0769f2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954fb482-98d7-4e85-bfc2-aa5f489c6b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Volume ceb151f8-7c16-432e-be77-63651201f121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb151f8-7c16-432e-be77-63651201f121', 'volume_size': 1}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1627328192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb151f8-7c16-432e-be77-63651201f121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee3c3d08b5b4494a5c9cc2c2379bbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:01Z,use_quota=True,user_id='b537c4011556432c9a3cd6b6ae7981de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Creating volume ceb151f8-7c16-432e-be77-63651201f121 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:01 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-quobyte-d36c811b-88ca-4fa9-bff2-46b4c42a5b75" released by "delete_volume" :: held 1.668s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:01 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121 1073741824
Nov 05 03:50:01 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Created reservations ['5d7a02f1-8c45-467b-9f02-745501571d63', 'c5bc6699-a32f-4460-9408-1e08601af691', 'c58422f9-d0dd-47ce-8fbd-ebc814da25a9', '348deb4b-d6ed-47f2-aa77-d8070974b839'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:01 devstack sudo[98777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:01 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:01 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Deleted volume successfully.
Nov 05 03:50:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0d92ba3d-3817-4ae9-947c-8cc3fc8aff36 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-d36c811b-88ca-4fa9-bff2-46b4c42a5b75-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:02 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121 1073741824" returned: 0 in 0.904s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:02 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121
Nov 05 03:50:02 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "cinder-33cda6df-3755-4c70-b01c-a27bcfe7e9a5-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-33cda6df-3755-4c70-b01c-a27bcfe7e9a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "cinder-quobyte-33cda6df-3755-4c70-b01c-a27bcfe7e9a5" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-quobyte-33cda6df-3755-4c70-b01c-a27bcfe7e9a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d203e035-ba8f-4154-b3c5-062405d6f734]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:02 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5
Nov 05 03:50:02 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:02 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954fb482-98d7-4e85-bfc2-aa5f489c6b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb151f8-7c16-432e-be77-63651201f121', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca629e9-dcd4-4a7d-b1fc-8fa533db5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Volume volume-ceb151f8-7c16-432e-be77-63651201f121 (ceb151f8-7c16-432e-be77-63651201f121): created successfully
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca629e9-dcd4-4a7d-b1fc-8fa533db5624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Flow 'volume_create_manager' (86ba04c4-e872-40c5-9184-3a0610f73c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-605f005a-98d3-4607-a476-5a838575599d tempest-VolumesMetadataTest-1846912451 None] Created volume successfully.
Nov 05 03:50:02 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5" returned: 0 in 0.491s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:02 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5
Nov 05 03:50:02 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:03 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-33cda6df-3755-4c70-b01c-a27bcfe7e9a5" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-quobyte-33cda6df-3755-4c70-b01c-a27bcfe7e9a5" released by "delete_volume" :: held 0.907s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Created reservations ['2e5e025c-6823-4174-9f93-a70d91bbb78f', 'f7e377b4-c967-42b1-b6bd-cfa86885db84', 'fcf51e83-5bd6-495f-8232-53de948680c8', '9d145196-bd1f-4720-a348-8460c947528e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:03 devstack sudo[98798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:03 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:03 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Deleted volume successfully.
Nov 05 03:50:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0a553c78-8749-44ab-a187-e53574fec5ca tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-33cda6df-3755-4c70-b01c-a27bcfe7e9a5-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "cinder-38f8e53c-81f0-4676-94de-06471dece7ca-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-38f8e53c-81f0-4676-94de-06471dece7ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "cinder-quobyte-38f8e53c-81f0-4676-94de-06471dece7ca" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-quobyte-38f8e53c-81f0-4676-94de-06471dece7ca" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1276e9b-2870-4a51-a84b-6ac1e1125f4a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:04 devstack sudo[98810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca
Nov 05 03:50:04 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Acquiring lock "cinder-ceb151f8-7c16-432e-be77-63651201f121-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Lock "cinder-ceb151f8-7c16-432e-be77-63651201f121-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:04 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca" returned: 0 in 0.676s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:05 devstack sudo[98821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca
Nov 05 03:50:05 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Acquiring lock "cinder-quobyte-ceb151f8-7c16-432e-be77-63651201f121" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Lock "cinder-quobyte-ceb151f8-7c16-432e-be77-63651201f121" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[268cd3c7-f665-48f8-ad13-695fee597b3f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-4bec3a02-1079-4e0b-9faa-5fe26ac2077b req-e25c661b-c882-4f95-921e-c3f6ff802324 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-4bec3a02-1079-4e0b-9faa-5fe26ac2077b req-e25c661b-c882-4f95-921e-c3f6ff802324 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:05 devstack sudo[98825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121
Nov 05 03:50:05 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-4bec3a02-1079-4e0b-9faa-5fe26ac2077b req-e25c661b-c882-4f95-921e-c3f6ff802324 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-4bec3a02-1079-4e0b-9faa-5fe26ac2077b req-e25c661b-c882-4f95-921e-c3f6ff802324 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-eded58a3-29fd-4e6d-b680-77dd8077306a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72b1bfe8-eeaa-4b6e-bf14-835d9b56eb1c', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:50:05 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-38f8e53c-81f0-4676-94de-06471dece7ca" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-quobyte-38f8e53c-81f0-4676-94de-06471dece7ca" released by "delete_volume" :: held 1.227s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-4bec3a02-1079-4e0b-9faa-5fe26ac2077b req-e25c661b-c882-4f95-921e-c3f6ff802324 tempest-TestServerVolumeAttachmentScenario-2104288510 None] attachment_update completed successfully.
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Created reservations ['0d9b8f02-6baa-449b-a59e-2568aecd1dfe', 'e08143bb-e981-4e92-b062-5dd26a4f633a', '98e387a2-ae1a-4fb2-ae5f-4bf22fcc304f', 'e79ca8ef-6dcb-44d4-8ff6-db26cb380b3a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:05 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:05 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:05 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121" returned: 0 in 0.621s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:05 devstack sudo[98837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121
Nov 05 03:50:05 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:06 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Deleted volume successfully.
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a847839a-6d3e-4ac0-887d-7c22f2a50fa4 tempest-AttachVolumeNegativeTest-1809005525 None] Lock "cinder-38f8e53c-81f0-4676-94de-06471dece7ca-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:06 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ceb151f8-7c16-432e-be77-63651201f121" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Lock "cinder-quobyte-ceb151f8-7c16-432e-be77-63651201f121" released by "delete_volume" :: held 1.170s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Created reservations ['f39aea27-e1e1-4d6a-8eae-4b33725bda3e', '13ad5081-00c3-48bb-aa86-f33091284d18', '63a393b3-3c2e-42f4-990b-b3650dba84a0', 'faad7e5d-8838-4766-8537-540ea7aca9a1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:06 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:06 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:06 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Deleted volume successfully.
Nov 05 03:50:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bf096b99-5ef2-4f06-ac52-d05c40d41523 tempest-VolumesMetadataTest-1846912451 None] Lock "cinder-ceb151f8-7c16-432e-be77-63651201f121-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-4d4ca89f-f514-4004-be58-cd85b4581fab req-9ee4bec8-0bd5-4b94-8e6c-5e7793c3ec30 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Terminate volume connection completed successfully.
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-4d4ca89f-f514-4004-be58-cd85b4581fab req-9ee4bec8-0bd5-4b94-8e6c-5e7793c3ec30 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Deleting attachment 72b1bfe8-eeaa-4b6e-bf14-835d9b56eb1c. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:08 devstack sudo[98881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:08 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:09 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:50:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:50:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-d0e252ff-adfa-4245-8841-32c12e243323 req-842f66ba-1bcd-401f-80b6-7c86f1a31f1e tempest-TestServerVolumeAttachmentScenario-2104288510 None] Terminate volume connection completed successfully.
Nov 05 03:50:10 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0e252ff-adfa-4245-8841-32c12e243323 req-842f66ba-1bcd-401f-80b6-7c86f1a31f1e tempest-TestServerVolumeAttachmentScenario-2104288510 None] Deleting attachment 38ef7a16-44de-4f7d-9e56-74a6dc910071. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:50:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "cinder-eded58a3-29fd-4e6d-b680-77dd8077306a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-eded58a3-29fd-4e6d-b680-77dd8077306a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "cinder-quobyte-eded58a3-29fd-4e6d-b680-77dd8077306a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-quobyte-eded58a3-29fd-4e6d-b680-77dd8077306a" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d72cb-bbf3-4f65-8f08-8316fc3f4eec]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:18 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a
Nov 05 03:50:18 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:19 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a" returned: 0 in 0.588s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:19 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a
Nov 05 03:50:19 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Flow 'volume_create_manager' (de2b6aa7-bb4f-48d2-9595-6d1f9fe55e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15596348-b589-4289-9343-70089d3d9551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15596348-b589-4289-9343-70089d3d9551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1028662261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46374843-d83b-4f98-8904-f0acb6f21c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd60fc57a6344a6aec20f9ba8697420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:19Z,use_quota=True,user_id='7fc742e845e24c2a90e8dfd115d3a5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4647740-cf12-4c4d-8d97-c6127bfab493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4647740-cf12-4c4d-8d97-c6127bfab493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303a3632-ff4d-41f1-a72a-8f934a148471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303a3632-ff4d-41f1-a72a-8f934a148471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46374843-d83b-4f98-8904-f0acb6f21c71', 'volume_name': 'volume-46374843-d83b-4f98-8904-f0acb6f21c71', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13af7666-a96a-423b-97e4-4af5e3ab1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13af7666-a96a-423b-97e4-4af5e3ab1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029e2fd8-0ad6-49e1-90f2-022e224ee8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Volume 46374843-d83b-4f98-8904-f0acb6f21c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46374843-d83b-4f98-8904-f0acb6f21c71', 'volume_size': 1}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1028662261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46374843-d83b-4f98-8904-f0acb6f21c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd60fc57a6344a6aec20f9ba8697420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:19Z,use_quota=True,user_id='7fc742e845e24c2a90e8dfd115d3a5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Creating volume 46374843-d83b-4f98-8904-f0acb6f21c71 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:19 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-eded58a3-29fd-4e6d-b680-77dd8077306a" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-quobyte-eded58a3-29fd-4e6d-b680-77dd8077306a" released by "delete_volume" :: held 1.127s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:19 devstack sudo[98946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71 1073741824
Nov 05 03:50:19 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Created reservations ['3d2f400d-bb1c-47da-bc35-ac2635245037', 'd78fb3ca-d6fd-45ca-b0cb-8995bcb08ade', '16a00184-941b-4430-aa04-4cda1a117454', 'bb0367ad-f998-4e90-8f0f-834ee2eeaa23'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:19 devstack sudo[98948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:19 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:20 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Deleted volume successfully.
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fee0a4a-aaf3-4e5d-81a6-49c2446009bf tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-eded58a3-29fd-4e6d-b680-77dd8077306a-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:20 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71 1073741824" returned: 0 in 0.701s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:20 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71
Nov 05 03:50:20 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:20 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029e2fd8-0ad6-49e1-90f2-022e224ee8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46374843-d83b-4f98-8904-f0acb6f21c71', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1595bf-0867-4bd8-98c2-1c3cfed51467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Volume volume-46374843-d83b-4f98-8904-f0acb6f21c71 (46374843-d83b-4f98-8904-f0acb6f21c71): created successfully
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1595bf-0867-4bd8-98c2-1c3cfed51467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Flow 'volume_create_manager' (de2b6aa7-bb4f-48d2-9595-6d1f9fe55e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d53213cf-75e5-4b19-b58d-f88637c66aa3 tempest-AttachVolumeTestJSON-1042114128 None] Created volume successfully.
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "cinder-d7d9c68c-7327-40e3-9726-1c40619d1483-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-d7d9c68c-7327-40e3-9726-1c40619d1483-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "cinder-quobyte-d7d9c68c-7327-40e3-9726-1c40619d1483" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-quobyte-d7d9c68c-7327-40e3-9726-1c40619d1483" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbafdbd-89af-435f-8b25-a5c6750a3900]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:21 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483
Nov 05 03:50:21 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:21 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483" returned: 0 in 0.653s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:21 devstack sudo[98972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483
Nov 05 03:50:21 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:22 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7d9c68c-7327-40e3-9726-1c40619d1483" returned: 0 in 0.610s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-quobyte-d7d9c68c-7327-40e3-9726-1c40619d1483" released by "delete_volume" :: held 1.351s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Created reservations ['9f67e445-52a0-4c28-9e6c-0a3ffaa4394d', '1504dd52-5785-4f1c-be0b-d479cf2a5b6b', 'b03ca0ae-1501-43bd-b54d-c5b68aad5d9e', '834fca7f-b93d-4168-b2a6-78bfe4120c39'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:22 devstack sudo[98987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:22 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-ccaedc33-3a65-454f-9bd6-b144c7954433 req-39f55bf5-c7da-4115-ae74-3e25118f93d5 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-ccaedc33-3a65-454f-9bd6-b144c7954433 req-39f55bf5-c7da-4115-ae74-3e25118f93d5 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-ccaedc33-3a65-454f-9bd6-b144c7954433 req-39f55bf5-c7da-4115-ae74-3e25118f93d5 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-ccaedc33-3a65-454f-9bd6-b144c7954433 req-39f55bf5-c7da-4115-ae74-3e25118f93d5 tempest-AttachVolumeTestJSON-1042114128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-46374843-d83b-4f98-8904-f0acb6f21c71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '182d3f3b-7a35-4984-b53b-886bf081ed5a', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:50:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-ccaedc33-3a65-454f-9bd6-b144c7954433 req-39f55bf5-c7da-4115-ae74-3e25118f93d5 tempest-AttachVolumeTestJSON-1042114128 None] attachment_update completed successfully.
Nov 05 03:50:22 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Deleted volume successfully.
Nov 05 03:50:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f4fe2707-57b7-44f6-b08a-7d7d9005cb03 tempest-TestServerVolumeAttachmentScenario-2104288510 None] Lock "cinder-d7d9c68c-7327-40e3-9726-1c40619d1483-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=70,cinder:SELECT=84,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=90,cinder:INSERT=22,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Flow 'volume_create_manager' (f81d673c-9364-43d6-bc44-25e15f1d905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35230ef-5d7d-4737-80f1-ac10737768c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35230ef-5d7d-4737-80f1-ac10737768c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2091708904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1cca4c-a392-4bf8-b6c9-efd699b73371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd60fc57a6344a6aec20f9ba8697420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:26Z,use_quota=True,user_id='7fc742e845e24c2a90e8dfd115d3a5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5d2dcc-2046-4f13-b058-23d0d21902b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5d2dcc-2046-4f13-b058-23d0d21902b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab72f6db-f03c-4242-9d51-61d821c71ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab72f6db-f03c-4242-9d51-61d821c71ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1cca4c-a392-4bf8-b6c9-efd699b73371', 'volume_name': 'volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f3ee35-c0ba-4e98-8d4a-beae7d2a3c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f3ee35-c0ba-4e98-8d4a-beae7d2a3c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef81a3b7-9573-4147-a49a-3ef64c68b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Volume 8c1cca4c-a392-4bf8-b6c9-efd699b73371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371', 'volume_size': 1}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2091708904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1cca4c-a392-4bf8-b6c9-efd699b73371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd60fc57a6344a6aec20f9ba8697420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:26Z,use_quota=True,user_id='7fc742e845e24c2a90e8dfd115d3a5e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Creating volume 8c1cca4c-a392-4bf8-b6c9-efd699b73371 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:25 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:25 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 1073741824
Nov 05 03:50:25 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:26 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 1073741824" returned: 0 in 0.738s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:26 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371
Nov 05 03:50:26 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:27 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef81a3b7-9573-4147-a49a-3ef64c68b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061e28f7-2d11-4928-8af7-0cf0f49c13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Volume volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 (8c1cca4c-a392-4bf8-b6c9-efd699b73371): created successfully
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061e28f7-2d11-4928-8af7-0cf0f49c13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Flow 'volume_create_manager' (f81d673c-9364-43d6-bc44-25e15f1d905d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b09a11a5-cea1-4c64-b6ea-a719f3232013 tempest-AttachVolumeTestJSON-1042114128 None] Created volume successfully.
Nov 05 03:50:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5842c16-5acc-4b96-9f2e-a31a75782b4c tempest-GroupsTest-19860887 None] Group tempest-Group1-42285649: creating
Nov 05 03:50:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5842c16-5acc-4b96-9f2e-a31a75782b4c tempest-GroupsTest-19860887 None] Group tempest-Group1-42285649: created successfully
Nov 05 03:50:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5842c16-5acc-4b96-9f2e-a31a75782b4c tempest-GroupsTest-19860887 None] Create group completed successfully.
Nov 05 03:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3fe09e68-174d-4870-8091-24f081a468be req-7a9cdc8e-b88b-41b3-97ce-de0e9b765432 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3fe09e68-174d-4870-8091-24f081a468be req-7a9cdc8e-b88b-41b3-97ce-de0e9b765432 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3fe09e68-174d-4870-8091-24f081a468be req-7a9cdc8e-b88b-41b3-97ce-de0e9b765432 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-3fe09e68-174d-4870-8091-24f081a468be req-7a9cdc8e-b88b-41b3-97ce-de0e9b765432 tempest-AttachVolumeTestJSON-1042114128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e83a9e81-739a-4080-85ec-57f2edec0882', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:50:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-3fe09e68-174d-4870-8091-24f081a468be req-7a9cdc8e-b88b-41b3-97ce-de0e9b765432 tempest-AttachVolumeTestJSON-1042114128 None] attachment_update completed successfully.
Nov 05 03:50:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b9f4c241-69d3-4066-a646-304ec972e0e0 tempest-GroupsTest-19860887 None] Group tempest-Group2-1602631057: creating
Nov 05 03:50:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b9f4c241-69d3-4066-a646-304ec972e0e0 tempest-GroupsTest-19860887 None] Group tempest-Group2-1602631057: created successfully
Nov 05 03:50:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b9f4c241-69d3-4066-a646-304ec972e0e0 tempest-GroupsTest-19860887 None] Create group completed successfully.
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Flow 'volume_create_manager' (29c22b39-9890-48c4-a162-09cbacda1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7583c965-b303-4e6c-961e-615f6b4e99a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7583c965-b303-4e6c-961e-615f6b4e99a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1320877151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9261c9a-dfac-4677-8def-b7dea4a80877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae2b7cc3f664cc495f0aa39f3d0a013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:31Z,use_quota=True,user_id='dc5b6718435b43d5a0691b3a1e1200e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c82d87-5523-4a63-bdf1-15941e04215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c82d87-5523-4a63-bdf1-15941e04215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691f8420-3bf6-4a51-aeb1-ef14eefa1a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691f8420-3bf6-4a51-aeb1-ef14eefa1a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9261c9a-dfac-4677-8def-b7dea4a80877', 'volume_name': 'volume-e9261c9a-dfac-4677-8def-b7dea4a80877', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d8fb82-74d9-4354-97ff-74d70e88827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d8fb82-74d9-4354-97ff-74d70e88827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e456cb4-1b7f-4e82-a008-ecbd1c30101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Volume e9261c9a-dfac-4677-8def-b7dea4a80877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9261c9a-dfac-4677-8def-b7dea4a80877', 'volume_size': 1}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1320877151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9261c9a-dfac-4677-8def-b7dea4a80877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae2b7cc3f664cc495f0aa39f3d0a013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:31Z,use_quota=True,user_id='dc5b6718435b43d5a0691b3a1e1200e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Creating volume e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:30 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:30 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 1073741824
Nov 05 03:50:30 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:31 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 1073741824" returned: 0 in 0.599s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:31 devstack sudo[99438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:50:31 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:31 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.409s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e456cb4-1b7f-4e82-a008-ecbd1c30101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9261c9a-dfac-4677-8def-b7dea4a80877', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed136c79-d0c9-41da-ba2d-d41c068fa31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Volume volume-e9261c9a-dfac-4677-8def-b7dea4a80877 (e9261c9a-dfac-4677-8def-b7dea4a80877): created successfully
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed136c79-d0c9-41da-ba2d-d41c068fa31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Flow 'volume_create_manager' (29c22b39-9890-48c4-a162-09cbacda1500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c59d350d-d216-4a58-8f87-59a67fe4dc62 tempest-VolumesActionsTest-313682368 None] Created volume successfully.
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Flow 'volume_create_manager' (16b00798-1206-4670-bb28-9d80d530f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94380ba2-baf9-4532-a05d-221b012ff567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94380ba2-baf9-4532-a05d-221b012ff567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-98169636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d80ce040-fda3-4c1a-9678-343c1dae7ac5,host='devstack@QuobyteHD#QuobyteHD',id=3ddd3c57-e3bf-46ce-86b1-5598aff5bf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408d692e76a4e9b9bcbde006292b0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:32Z,use_quota=True,user_id='354ef32e080a4c7daad1e2dd9b4dfea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f571ab-45ec-4d1c-babf-a5bd4d5331e4),volume_type_id=c8f571ab-45ec-4d1c-babf-a5bd4d5331e4)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e587a667-5a1b-448d-a8c8-e9ac9dd909cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e587a667-5a1b-448d-a8c8-e9ac9dd909cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd3581f-0530-435a-a2bb-e08fbd4bb7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd3581f-0530-435a-a2bb-e08fbd4bb7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddd3c57-e3bf-46ce-86b1-5598aff5bf87', 'volume_name': 'volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0f59e-5051-4f99-abf3-76f93bd48966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0f59e-5051-4f99-abf3-76f93bd48966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8af33d-e4a9-4dc3-8630-765839e5ca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Volume 3ddd3c57-e3bf-46ce-86b1-5598aff5bf87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87', 'volume_size': 1}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d80ce040-fda3-4c1a-9678-343c1dae7ac5,created_at=2026-11-05T02:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-98169636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d80ce040-fda3-4c1a-9678-343c1dae7ac5,host='devstack@QuobyteHD#QuobyteHD',id=3ddd3c57-e3bf-46ce-86b1-5598aff5bf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408d692e76a4e9b9bcbde006292b0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:32Z,use_quota=True,user_id='354ef32e080a4c7daad1e2dd9b4dfea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f571ab-45ec-4d1c-babf-a5bd4d5331e4),volume_type_id=c8f571ab-45ec-4d1c-babf-a5bd4d5331e4)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Creating volume 3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:32 devstack sudo[99443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 1073741824
Nov 05 03:50:32 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-004cea75-2694-4441-bdd8-49b1b770b427 req-a85c9402-a9b2-41cc-a810-4593a0f6a894 tempest-AttachVolumeTestJSON-1042114128 None] Terminate volume connection completed successfully.
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-004cea75-2694-4441-bdd8-49b1b770b427 req-a85c9402-a9b2-41cc-a810-4593a0f6a894 tempest-AttachVolumeTestJSON-1042114128 None] Deleting attachment 182d3f3b-7a35-4984-b53b-886bf081ed5a. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:50:32 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 1073741824" returned: 0 in 0.653s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:33 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87
Nov 05 03:50:33 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:33 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87" returned: 0 in 0.502s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8af33d-e4a9-4dc3-8630-765839e5ca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59c89d4-6755-4c4e-b7ee-36d59623d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Volume volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 (3ddd3c57-e3bf-46ce-86b1-5598aff5bf87): created successfully
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59c89d4-6755-4c4e-b7ee-36d59623d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Flow 'volume_create_manager' (16b00798-1206-4670-bb28-9d80d530f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-68ab3637-268e-4b11-87d6-591d18bd5c18 tempest-GroupsTest-19860887 None] Created volume successfully.
Nov 05 03:50:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-d46f8825-4ff0-4f3e-be84-b4d1717ec83d req-0793f374-bdb7-41d4-8202-29f7730facaf tempest-AttachVolumeTestJSON-1042114128 None] Terminate volume connection completed successfully.
Nov 05 03:50:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d46f8825-4ff0-4f3e-be84-b4d1717ec83d req-0793f374-bdb7-41d4-8202-29f7730facaf tempest-AttachVolumeTestJSON-1042114128 None] Deleting attachment e83a9e81-739a-4080-85ec-57f2edec0882. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:50:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Acquiring lock "cinder-quobyte-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Lock "cinder-quobyte-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2823edbd-a34c-450f-95e6-ac4586240da5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:36 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87
Nov 05 03:50:36 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:36 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87" returned: 0 in 0.891s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:37 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87
Nov 05 03:50:37 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:37 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Lock "cinder-quobyte-3ddd3c57-e3bf-46ce-86b1-5598aff5bf87" released by "delete_volume" :: held 1.337s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Created reservations ['b7d8b0ac-c42c-4585-800a-f03e47d98356'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:37 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1897699444 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1897699444, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:37 devstack cinder-volume[87098]: WARNING cinder.quota [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1897699444 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1897699444, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Created reservations ['08c3fd64-3f96-47f7-8b74-e8af3d4ddf1a', '506e3e4b-fcef-4057-a645-857393b4fd1a', 'a9564b18-7b64-427a-bdd8-d56039617c0f', 'e2382ea8-0320-4262-ae5a-8a5e0ba7ae25'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:37 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:37 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:38 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2dfa59d5-1bbc-49cd-8e92-77beb170f5f3 tempest-GroupsTest-19860887 None] Delete group completed successfully.
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Created reservations ['f8fd9e3f-a93f-4d14-af62-05592aa87a87'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:39 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:39 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:39 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:39 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7ad080c0-65d1-4976-93be-d4031dfeaad0 tempest-GroupsTest-19860887 None] Delete group completed successfully.
Nov 05 03:50:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a690c533-ebaf-47cb-b4d5-d2548afa6aef tempest-GroupsTest-19860887 None] Group tempest-GroupsTest-Group-714994957: creating
Nov 05 03:50:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a690c533-ebaf-47cb-b4d5-d2548afa6aef tempest-GroupsTest-19860887 None] Group tempest-GroupsTest-Group-714994957: created successfully
Nov 05 03:50:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a690c533-ebaf-47cb-b4d5-d2548afa6aef tempest-GroupsTest-19860887 None] Create group completed successfully.
Nov 05 03:50:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "cinder-8c1cca4c-a392-4bf8-b6c9-efd699b73371-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-8c1cca4c-a392-4bf8-b6c9-efd699b73371-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "cinder-quobyte-8c1cca4c-a392-4bf8-b6c9-efd699b73371" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-quobyte-8c1cca4c-a392-4bf8-b6c9-efd699b73371" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f19cb-b498-475a-85ab-405c310f6dd6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:42 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371
Nov 05 03:50:42 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:43 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371" returned: 0 in 1.050s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:43 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371
Nov 05 03:50:43 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Flow 'volume_create_manager' (115f3d53-1d44-4064-89de-38739dd55179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:43 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be28e1f-00e8-4457-993c-d10db9c984ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8c1cca4c-a392-4bf8-b6c9-efd699b73371" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be28e1f-00e8-4457-993c-d10db9c984ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2098503534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f269993-5fca-40cb-9465-f588ab5b2952,host='devstack@QuobyteHD#QuobyteHD',id=8a5a937a-99b4-48cd-ad5d-601c6e30b9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408d692e76a4e9b9bcbde006292b0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:44Z,use_quota=True,user_id='354ef32e080a4c7daad1e2dd9b4dfea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c94fbbfa-82f5-4ac5-81e8-3b040065338c),volume_type_id=c94fbbfa-82f5-4ac5-81e8-3b040065338c)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31919dfd-bb2d-4d8e-b8e9-f5b5e52145e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31919dfd-bb2d-4d8e-b8e9-f5b5e52145e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6123ad6e-f0d7-4e66-8723-d22abbc46b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6123ad6e-f0d7-4e66-8723-d22abbc46b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5a937a-99b4-48cd-ad5d-601c6e30b9e2', 'volume_name': 'volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad5a73-be67-4a92-ac6d-45db88e8c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad5a73-be67-4a92-ac6d-45db88e8c651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c953078-6aeb-497f-b2f2-5b3c42d7452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Volume 8a5a937a-99b4-48cd-ad5d-601c6e30b9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2', 'volume_size': 1}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f269993-5fca-40cb-9465-f588ab5b2952,created_at=2026-11-05T02:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2098503534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f269993-5fca-40cb-9465-f588ab5b2952,host='devstack@QuobyteHD#QuobyteHD',id=8a5a937a-99b4-48cd-ad5d-601c6e30b9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408d692e76a4e9b9bcbde006292b0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:44Z,use_quota=True,user_id='354ef32e080a4c7daad1e2dd9b4dfea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c94fbbfa-82f5-4ac5-81e8-3b040065338c),volume_type_id=c94fbbfa-82f5-4ac5-81e8-3b040065338c)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Creating volume 8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-quobyte-8c1cca4c-a392-4bf8-b6c9-efd699b73371" released by "delete_volume" :: held 1.870s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:44 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 1073741824
Nov 05 03:50:44 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Created reservations ['cbb7d032-815e-4c8e-aa1f-728167ef16c8', '82485dac-5419-4c65-a691-bf8825526142', '5a236338-a0e5-43e8-9f0e-021c5001c916', '8a4d79aa-c253-42f4-ae3b-c5fad1cbe6f2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:44 devstack sudo[99622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:44 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "cinder-46374843-d83b-4f98-8904-f0acb6f21c71-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-46374843-d83b-4f98-8904-f0acb6f21c71-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "cinder-quobyte-46374843-d83b-4f98-8904-f0acb6f21c71" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-quobyte-46374843-d83b-4f98-8904-f0acb6f21c71" acquired by "delete_volume" :: waited 0.075s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[425d6e98-71a7-4190-9009-aa5b7361c6e6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:45 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.759s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Deleted volume successfully.
Nov 05 03:50:45 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71
Nov 05 03:50:45 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f0caa050-4a2a-41b5-b233-2b8119f99d62 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-8c1cca4c-a392-4bf8-b6c9-efd699b73371-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:45 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 1073741824" returned: 0 in 1.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:45 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2
Nov 05 03:50:45 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:45 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71" returned: 0 in 0.894s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:45 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:45 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71
Nov 05 03:50:45 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c953078-6aeb-497f-b2f2-5b3c42d7452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a57bc6-3fa1-4612-9772-122c6e8da3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Volume volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 (8a5a937a-99b4-48cd-ad5d-601c6e30b9e2): created successfully
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a57bc6-3fa1-4612-9772-122c6e8da3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Flow 'volume_create_manager' (115f3d53-1d44-4064-89de-38739dd55179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-95996d73-d86e-4739-8679-30bad5fc29a4 tempest-GroupsTest-19860887 None] Created volume successfully.
Nov 05 03:50:46 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-46374843-d83b-4f98-8904-f0acb6f21c71" returned: 0 in 0.421s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-quobyte-46374843-d83b-4f98-8904-f0acb6f21c71" released by "delete_volume" :: held 1.447s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Created reservations ['18f3bf1c-7b63-4a0e-b843-00b05f0e6d37', 'fbebb49a-d32f-4a74-876d-8271a271feaf', 'bd2956fe-6483-4502-8136-15c0403f1722', 'e33be48b-f7c3-4f6c-8048-2e7212ce71c5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:46 devstack sudo[99639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:46 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:47 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.695s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Deleted volume successfully.
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7043f938-4b9c-48e4-921f-69975f12b785 tempest-VolumesActionsTest-313682368 None] Acquiring lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877" by "attach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-61e33ff4-2129-441c-ae9d-f99cd0e84f51 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-46374843-d83b-4f98-8904-f0acb6f21c71-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7043f938-4b9c-48e4-921f-69975f12b785 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877" acquired by "attach_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7043f938-4b9c-48e4-921f-69975f12b785 tempest-VolumesActionsTest-313682368 None] Attaching volume e9261c9a-dfac-4677-8def-b7dea4a80877 to instance 07c3e71b-180f-4815-98d1-c73a179f63c5 at mountpoint /dev/vdb on host None.
Nov 05 03:50:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7043f938-4b9c-48e4-921f-69975f12b785 tempest-VolumesActionsTest-313682368 None] Attach volume completed successfully.
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7043f938-4b9c-48e4-921f-69975f12b785 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877" released by "attach_volume" :: held 0.215s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "cinder-03b262e6-631a-48ce-b9ca-c3ead4e459a0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-03b262e6-631a-48ce-b9ca-c3ead4e459a0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Flow 'volume_create_manager' (1674086f-1d9f-4785-88c6-63b8c2ad920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7b0c9b-e3d5-4093-9833-c18d7f932c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "cinder-quobyte-03b262e6-631a-48ce-b9ca-c3ead4e459a0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7b0c9b-e3d5-4093-9833-c18d7f932c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241453080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f269993-5fca-40cb-9465-f588ab5b2952,host='devstack@QuobyteHD#QuobyteHD',id=e014c0d7-8422-4bd4-86a4-9677124f2472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408d692e76a4e9b9bcbde006292b0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:48Z,use_quota=True,user_id='354ef32e080a4c7daad1e2dd9b4dfea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c94fbbfa-82f5-4ac5-81e8-3b040065338c),volume_type_id=c94fbbfa-82f5-4ac5-81e8-3b040065338c)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a5ae4c-1f41-4b34-a889-752dfa03004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a5ae4c-1f41-4b34-a889-752dfa03004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09923240-bd7a-4609-bda5-132229de9a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09923240-bd7a-4609-bda5-132229de9a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e014c0d7-8422-4bd4-86a4-9677124f2472', 'volume_name': 'volume-e014c0d7-8422-4bd4-86a4-9677124f2472', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34fb71a-f7ac-42b9-8f01-76d8d3b13279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34fb71a-f7ac-42b9-8f01-76d8d3b13279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86575b3-03e3-460c-b675-f3956084c21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Volume e014c0d7-8422-4bd4-86a4-9677124f2472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e014c0d7-8422-4bd4-86a4-9677124f2472', 'volume_size': 1}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f269993-5fca-40cb-9465-f588ab5b2952,created_at=2026-11-05T02:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241453080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f269993-5fca-40cb-9465-f588ab5b2952,host='devstack@QuobyteHD#QuobyteHD',id=e014c0d7-8422-4bd4-86a4-9677124f2472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4408d692e76a4e9b9bcbde006292b0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:48Z,use_quota=True,user_id='354ef32e080a4c7daad1e2dd9b4dfea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c94fbbfa-82f5-4ac5-81e8-3b040065338c),volume_type_id=c94fbbfa-82f5-4ac5-81e8-3b040065338c)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Creating volume e014c0d7-8422-4bd4-86a4-9677124f2472 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:50:47 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7f2ad8d7-04e3-4af3-b163-a305f1981961 tempest-VolumesActionsTest-313682368 None] Acquiring lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-quobyte-03b262e6-631a-48ce-b9ca-c3ead4e459a0" acquired by "delete_volume" :: waited 0.117s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:48 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472 1073741824
Nov 05 03:50:48 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7f2ad8d7-04e3-4af3-b163-a305f1981961 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7f2ad8d7-04e3-4af3-b163-a305f1981961 tempest-VolumesActionsTest-313682368 None] Detaching volume e9261c9a-dfac-4677-8def-b7dea4a80877 from instance 07c3e71b-180f-4815-98d1-c73a179f63c5.
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc889a-2321-4093-a6af-20319f42d422]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7f2ad8d7-04e3-4af3-b163-a305f1981961 tempest-VolumesActionsTest-313682368 None] Detach volume completed successfully.
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7f2ad8d7-04e3-4af3-b163-a305f1981961 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:48 devstack sudo[99645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0
Nov 05 03:50:48 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:48 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472 1073741824" returned: 0 in 0.866s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:48 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0" returned: 0 in 0.835s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:48 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0
Nov 05 03:50:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:48 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:49 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472
Nov 05 03:50:49 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:49 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-03b262e6-631a-48ce-b9ca-c3ead4e459a0" returned: 0 in 0.545s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-quobyte-03b262e6-631a-48ce-b9ca-c3ead4e459a0" released by "delete_volume" :: held 1.463s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:49 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86575b3-03e3-460c-b675-f3956084c21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e014c0d7-8422-4bd4-86a4-9677124f2472', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2940ad17-1950-4b1d-b493-b8ac9be2950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:50:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Volume volume-e014c0d7-8422-4bd4-86a4-9677124f2472 (e014c0d7-8422-4bd4-86a4-9677124f2472): created successfully
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2940ad17-1950-4b1d-b493-b8ac9be2950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Flow 'volume_create_manager' (1674086f-1d9f-4785-88c6-63b8c2ad920c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Created reservations ['443f831e-b29a-4f2e-91ba-2491418cb67a', '445ef13f-0d28-414b-8248-cdc3e69af5d1', '8bc915aa-86b3-4770-88b6-f4a8225b086d', 'cdbb8fb8-fb78-41af-bcbb-ddfe0519578b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9f811a29-3453-487f-ba81-5a804a82fb37 tempest-GroupsTest-19860887 None] Created volume successfully.
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:49 devstack sudo[99681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:49 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:50 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.380s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Deleted volume successfully.
Nov 05 03:50:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a4fc0750-d28f-49c3-8f1a-a10c0ca4fbd0 tempest-AttachVolumeTestJSON-1042114128 None] Lock "cinder-03b262e6-631a-48ce-b9ca-c3ead4e459a0-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-13d28002-96b9-434d-a040-94d29c08264c tempest-GroupsTest-19860887 None] Update group completed successfully.
Nov 05 03:50:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6d2b00c-92e4-4fa2-93d4-1534c5e99b8f tempest-GroupsTest-19860887 None] Update group completed successfully.
Nov 05 03:50:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Acquiring lock "cinder-quobyte-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Lock "cinder-quobyte-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6333948f-49bb-436e-8d58-784e48c18397]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:54 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2
Nov 05 03:50:54 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:54 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2" returned: 0 in 0.538s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:54 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2
Nov 05 03:50:54 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:55 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Lock "cinder-quobyte-8a5a937a-99b4-48cd-ad5d-601c6e30b9e2" released by "delete_volume" :: held 0.916s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Acquiring lock "cinder-quobyte-e014c0d7-8422-4bd4-86a4-9677124f2472" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Lock "cinder-quobyte-e014c0d7-8422-4bd4-86a4-9677124f2472" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40d9d8-6255-4a6c-95f1-3d27aa506263]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:55 devstack sudo[99732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472
Nov 05 03:50:55 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:55 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472" returned: 0 in 0.523s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:55 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472
Nov 05 03:50:55 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:56 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e014c0d7-8422-4bd4-86a4-9677124f2472" returned: 0 in 0.304s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Lock "cinder-quobyte-e014c0d7-8422-4bd4-86a4-9677124f2472" released by "delete_volume" :: held 0.899s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Created reservations ['b195a6d1-458f-49ef-8287-6ab9354c1cf1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:56 devstack cinder-volume[87098]: WARNING cinder.quota [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-596237486 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-596237486, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:56 devstack cinder-volume[87098]: WARNING cinder.quota [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-596237486 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-596237486, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Created reservations ['58c95cb1-a5fe-4fd9-b72a-9a02d7507c92', '7d08d052-da0e-4f67-8dd5-01f988b02d70', 'd86e157c-4cda-429c-bc88-98c2b39d49e0', 'c46d2bfe-2d40-4937-9eca-7efc09bb311d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Created reservations ['35af214d-c8a2-494b-8aab-cb0fb979ee5d', '1affe945-2d0e-4baf-adf6-25c9b0f6d6c1', '8aa44984-3800-49a7-aa13-eecfd746137b', '70f91c18-96cc-43ae-9d97-dbfd99b01513'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:50:56 devstack sudo[99740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:50:56 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:50:56 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.297s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:50:56 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:50:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4dca5678-9475-4489-9af9-bc1bb956decb tempest-GroupsTest-19860887 None] Delete group completed successfully.
Nov 05 03:51:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Flow 'volume_create_manager' (c0fdc5ed-d789-4ddc-903a-80bb538a462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c95cacc-b93d-4471-b6d5-24d48da2fcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c95cacc-b93d-4471-b6d5-24d48da2fcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1870516169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f643df5-2b38-474c-9471-2792430763e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8febeeacee48e4babdc19f9a0e9722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:05Z,use_quota=True,user_id='3cdbf38f473546f1ae041c159ba7f04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30760315-3b90-4898-8915-f69a5de322cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30760315-3b90-4898-8915-f69a5de322cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bc025b-c405-49c5-aea8-ec5bac2605bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bc025b-c405-49c5-aea8-ec5bac2605bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f643df5-2b38-474c-9471-2792430763e5', 'volume_name': 'volume-5f643df5-2b38-474c-9471-2792430763e5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d70f442-8e3f-4b67-89db-2730d806d278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d70f442-8e3f-4b67-89db-2730d806d278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2351ff27-860d-4722-82e3-bd30c9254755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Volume 5f643df5-2b38-474c-9471-2792430763e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f643df5-2b38-474c-9471-2792430763e5', 'volume_size': 1}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1870516169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f643df5-2b38-474c-9471-2792430763e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8febeeacee48e4babdc19f9a0e9722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:05Z,use_quota=True,user_id='3cdbf38f473546f1ae041c159ba7f04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Creating volume 5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:05 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 1073741824
Nov 05 03:51:05 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:05 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 1073741824" returned: 0 in 0.741s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:05 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5
Nov 05 03:51:05 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:06 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5" returned: 0 in 0.732s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2351ff27-860d-4722-82e3-bd30c9254755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f643df5-2b38-474c-9471-2792430763e5', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce691edb-4733-4ad0-a7f2-be7348b9966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Volume volume-5f643df5-2b38-474c-9471-2792430763e5 (5f643df5-2b38-474c-9471-2792430763e5): created successfully
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce691edb-4733-4ad0-a7f2-be7348b9966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Flow 'volume_create_manager' (c0fdc5ed-d789-4ddc-903a-80bb538a462c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-d0a2fc28-504c-4f13-b85f-21b89f2b8c2e req-f675175d-050d-4655-90f3-389815f8a281 tempest-VolumesSnapshotsTestJSON-970231269 None] Created volume successfully.
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Creating offline snapshot 80e6885e-1b75-439e-b5a3-3f3ce7fff0ea of volume 5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[73526ac1-d62a-48ab-a26b-f419a25a9253]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:08 devstack sudo[99854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5
Nov 05 03:51:08 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:08 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:51:08 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:09 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5" returned: 0 in 1.121s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:09 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea 1G
Nov 05 03:51:09 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:09 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 1.004s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:51:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:51:10 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea 1G" returned: 0 in 0.757s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f643df5-2b38-474c-9471-2792430763e5 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:10 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f643df5-2b38-474c-9471-2792430763e5 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea
Nov 05 03:51:10 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:10 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f643df5-2b38-474c-9471-2792430763e5 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" returned: 0 in 0.626s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:10 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea is being set with open permissions: ugo+rw
Nov 05 03:51:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:10 devstack sudo[99878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea
Nov 05 03:51:10 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:11 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" returned: 0 in 0.546s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5340267-7f1b-4b3b-8ea9-1ef61f46327d tempest-VolumesActionsTest-313682368 None] Acquiring lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877" by "attach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5340267-7f1b-4b3b-8ea9-1ef61f46327d tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877" acquired by "attach_volume" :: waited 0.058s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:11 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info
Nov 05 03:51:11 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c5340267-7f1b-4b3b-8ea9-1ef61f46327d tempest-VolumesActionsTest-313682368 None] Attaching volume e9261c9a-dfac-4677-8def-b7dea4a80877 to instance 6c5dc949-fb1e-455d-8911-73ff9b88e84b at mountpoint /dev/vdb on host None.
Nov 05 03:51:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c5340267-7f1b-4b3b-8ea9-1ef61f46327d tempest-VolumesActionsTest-313682368 None] Attach volume completed successfully.
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5340267-7f1b-4b3b-8ea9-1ef61f46327d tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877" released by "attach_volume" :: held 0.291s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:11 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:11 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info is being set with open permissions: ugo+rw
Nov 05 03:51:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:12 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info
Nov 05 03:51:12 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6b11337-bbb9-4984-8f92-5b671bc02f90 tempest-VolumesActionsTest-313682368 None] Acquiring lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-detach_volume" by "detach_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6b11337-bbb9-4984-8f92-5b671bc02f90 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6b11337-bbb9-4984-8f92-5b671bc02f90 tempest-VolumesActionsTest-313682368 None] Detaching volume e9261c9a-dfac-4677-8def-b7dea4a80877 from instance 6c5dc949-fb1e-455d-8911-73ff9b88e84b.
Nov 05 03:51:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6b11337-bbb9-4984-8f92-5b671bc02f90 tempest-VolumesActionsTest-313682368 None] Detach volume completed successfully.
Nov 05 03:51:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6b11337-bbb9-4984-8f92-5b671bc02f90 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:12 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.info" returned: 0 in 0.660s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.609s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-e42720f2-46c5-4097-897f-62f588dfbce3 req-56811788-18e9-47e8-bd0a-b3abb40aebab tempest-VolumesSnapshotsTestJSON-970231269 None] Create snapshot completed successfully
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "cinder-80e6885e-1b75-439e-b5a3-3f3ce7fff0ea-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-80e6885e-1b75-439e-b5a3-3f3ce7fff0ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "cinder-quobyte-5f643df5-2b38-474c-9471-2792430763e5" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-quobyte-5f643df5-2b38-474c-9471-2792430763e5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "cinder-quobyte-80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-quobyte-80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Deleting offline snapshot 80e6885e-1b75-439e-b5a3-3f3ce7fff0ea of volume 5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] snapshot_file for this snap is: volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d42bfc7-cfca-467f-804c-386118c6ba20]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:14 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea
Nov 05 03:51:14 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:14 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" returned: 0 in 0.746s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f643df5-2b38-474c-9471-2792430763e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:51:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b62b8-7cf6-4582-bbda-211e83f8d507]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:15 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5
Nov 05 03:51:15 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:15 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:15 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea
Nov 05 03:51:15 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:16 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" returned: 0 in 0.565s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:16 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea
Nov 05 03:51:16 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:16 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5.80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" returned: 0 in 0.614s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-quobyte-80e6885e-1b75-439e-b5a3-3f3ce7fff0ea" released by "_delete_snapshot" :: held 2.721s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-quobyte-5f643df5-2b38-474c-9471-2792430763e5" released by "delete_snapshot" :: held 2.760s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:16 devstack cinder-volume[87098]: DEBUG cinder.quota [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Created reservations ['99dc116c-4953-4a0a-92f6-a4427a364d55', '0baafb48-64ba-48e5-9920-e7f7dc2a15e7', 'e7ee1a3c-a417-4f63-95a8-7353eafd6302', '5dbd1026-9903-4130-9a5b-6758eb5c13f9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Delete snapshot completed successfully.
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-343eef8b-1f1a-4001-91ca-e7c10c37fe7b req-fa7db665-731b-47f5-ae6c-2de5e0c537fe tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-80e6885e-1b75-439e-b5a3-3f3ce7fff0ea-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "cinder-5f643df5-2b38-474c-9471-2792430763e5-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-5f643df5-2b38-474c-9471-2792430763e5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "cinder-quobyte-5f643df5-2b38-474c-9471-2792430763e5" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-quobyte-5f643df5-2b38-474c-9471-2792430763e5" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[71534cdb-befb-452f-9965-8b6b85cf6005]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:18 devstack sudo[99929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5
Nov 05 03:51:18 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a08569-af5d-4242-b67a-5601d9580e5c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:18 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:51:18 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:18 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5" returned: 0 in 0.612s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:18 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5
Nov 05 03:51:18 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:18 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.573s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca800e9b-7df9-47d3-9bb1-a801608f4d13]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:18 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5f643df5-2b38-474c-9471-2792430763e5" returned: 0 in 0.453s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-quobyte-5f643df5-2b38-474c-9471-2792430763e5" released by "delete_volume" :: held 1.193s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:18 devstack cinder-volume[87098]: DEBUG cinder.quota [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Created reservations ['3351dddb-b904-44c8-9879-326814b5bcfd', 'a079821c-1c9c-4dd0-a17d-472e0c837691', '5ab2d04e-069a-4737-8eed-94825a2d8746', '466daa41-3601-4c34-9063-c3d1fd8712f2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:19 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:51:19 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:19 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:51:19 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:19 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.694s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.5b7f7e7f-0c6b-4987-94b9-2e6f916b2652py8s0ni8.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:19 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.5b7f7e7f-0c6b-4987-94b9-2e6f916b2652py8s0ni8.img
Nov 05 03:51:19 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:19 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.530s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG cinder.manager [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:51:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Deleted volume successfully.
Nov 05 03:51:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-1129afa6-700a-48ab-b3f3-29d25f595cc4 req-c0420c27-2293-4cd4-a770-0259023a92ef tempest-VolumesSnapshotsTestJSON-970231269 None] Lock "cinder-5f643df5-2b38-474c-9471-2792430763e5-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:29 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=98,cinder:SELECT=104,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:51:29 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.5b7f7e7f-0c6b-4987-94b9-2e6f916b2652py8s0ni8.img" returned: 0 in 10.085s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c777d644-3933-4841-ad23-887f80f90c2a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:29 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=106,cinder:INSERT=24,cinder:UPDATE=104,cinder:DELETE=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:51:29 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:51:29 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:30 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.838s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:30 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877, size 1024.00 MB, duration 10.09 sec, destination /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.5b7f7e7f-0c6b-4987-94b9-2e6f916b2652py8s0ni8.img {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:51:30 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Converted 1024.00 MB image at 101.50 MB/s
Nov 05 03:51:30 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] 5b7f7e7f-0c6b-4987-94b9-2e6f916b2652 was raw, no need to convert to raw {{(pid=87098) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Flow 'volume_create_manager' (d097b39f-7642-4a7e-9473-ac07afa0d3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c83d471-5efb-4bc3-820f-29cfacb848f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c83d471-5efb-4bc3-820f-29cfacb848f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-289348845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588ad5dd-671e-4ab5-a9b8-b86797d36882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90060c7e074de8885df6fc15a53845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:33Z,use_quota=True,user_id='122d4ff1691b459b8f9e949105389ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d780719a-7ce8-44f2-8091-9734ad399c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d780719a-7ce8-44f2-8091-9734ad399c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da72c7ed-7592-4b75-97ba-730964107e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da72c7ed-7592-4b75-97ba-730964107e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588ad5dd-671e-4ab5-a9b8-b86797d36882', 'volume_name': 'volume-588ad5dd-671e-4ab5-a9b8-b86797d36882', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f3137c-434a-4712-b4eb-88d918cf3df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f3137c-434a-4712-b4eb-88d918cf3df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba9dbd7-038b-4fba-a46f-61720672ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Volume 588ad5dd-671e-4ab5-a9b8-b86797d36882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588ad5dd-671e-4ab5-a9b8-b86797d36882', 'volume_size': 1}
Nov 05 03:51:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Flow 'volume_create_manager' (56f64c35-3368-4741-b6c0-ed751f5d212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed2dd33-51b8-4295-a237-9ca21ef238a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed2dd33-51b8-4295-a237-9ca21ef238a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1352206619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3024d46-6e30-41cc-a522-5aed4d6ba71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56259dd9db8243a1a100e54d920f4201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:37Z,use_quota=True,user_id='a749efd36fe84b5b8c0cd9b01249d6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49e08f5-ca4d-4012-904d-0fce3be68335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49e08f5-ca4d-4012-904d-0fce3be68335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e20c66-cf56-4bd0-886b-77b6451f80ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e20c66-cf56-4bd0-886b-77b6451f80ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3024d46-6e30-41cc-a522-5aed4d6ba71a', 'volume_name': 'volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b73503c7a0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716a418e-0205-481c-a2fc-9fcfe8689f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716a418e-0205-481c-a2fc-9fcfe8689f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cf9e03-5790-4240-8ba5-b31524c241a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Volume f3024d46-6e30-41cc-a522-5aed4d6ba71a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b73503c7a0>}
Nov 05 03:51:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Trying to clone f3024d46-6e30-41cc-a522-5aed4d6ba71a from image b168d99d-9565-4249-9e41-af4fab9708fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Flow 'volume_create_manager' (abf12145-cb3f-4e6c-a5b4-cfb261b004c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e7544d-274a-43e9-ae9a-6a539968f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e7544d-274a-43e9-ae9a-6a539968f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-711946552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbea97b6-1228-4181-907c-4b2deec44e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc21b2bd114ca89905c03eaac91b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:38Z,use_quota=True,user_id='88d9502336bf4774b6d88ed7b985e8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ffde9d-397d-43f9-8bcb-5d44487a28d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ffde9d-397d-43f9-8bcb-5d44487a28d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d88052-c2d6-4383-bb36-d0f1be9bd452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d88052-c2d6-4383-bb36-d0f1be9bd452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbea97b6-1228-4181-907c-4b2deec44e2b', 'volume_name': 'volume-cbea97b6-1228-4181-907c-4b2deec44e2b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d627959c-c370-4c33-942d-aed45867e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d627959c-c370-4c33-942d-aed45867e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ea89a-5d9c-4463-a66f-afdce840ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Volume cbea97b6-1228-4181-907c-4b2deec44e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbea97b6-1228-4181-907c-4b2deec44e2b', 'volume_size': 1}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:51:38 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d2b45-45ef-4e79-bec3-30d6ed13d00f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:38 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD
Nov 05 03:51:38 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:38 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:38 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb is fetched for user a749efd36fe84b5b8c0cd9b01249d6f2. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:51:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d5da1a-bd63-475b-ba6e-50244a607687]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:39 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD
Nov 05 03:51:39 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:39 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:49 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:51:49 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.107s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Uploaded volume to glance image-id: 5b7f7e7f-0c6b-4987-94b9-2e6f916b2652. {{(pid=87098) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.273s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-289348845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588ad5dd-671e-4ab5-a9b8-b86797d36882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90060c7e074de8885df6fc15a53845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:33Z,use_quota=True,user_id='122d4ff1691b459b8f9e949105389ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Creating volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:53 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 1073741824
Nov 05 03:51:53 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-66595f2b-e5d7-4052-ba4f-73da639c3d9a tempest-VolumesActionsTest-313682368 None] Copy volume to image completed successfully.
Nov 05 03:51:53 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 1073741824" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:53 devstack sudo[99991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882
Nov 05 03:51:53 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:54 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.779s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-711946552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbea97b6-1228-4181-907c-4b2deec44e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6fc21b2bd114ca89905c03eaac91b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:38Z,use_quota=True,user_id='88d9502336bf4774b6d88ed7b985e8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Creating volume cbea97b6-1228-4181-907c-4b2deec44e2b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:54 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba9dbd7-038b-4fba-a46f-61720672ee19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588ad5dd-671e-4ab5-a9b8-b86797d36882', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:54 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b 1073741824
Nov 05 03:51:54 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2af578e-8a61-44bb-bc1e-5d397335d0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Volume volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 (588ad5dd-671e-4ab5-a9b8-b86797d36882): created successfully
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2af578e-8a61-44bb-bc1e-5d397335d0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Flow 'volume_create_manager' (d097b39f-7642-4a7e-9473-ac07afa0d3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-610f871b-44a5-49ec-b6b7-c18f666adb77 tempest-SnapshotsActionsTest-675907272 None] Created volume successfully.
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:54 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b 1073741824" returned: 0 in 0.691s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:54 devstack sudo[100036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b
Nov 05 03:51:54 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:55 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b" returned: 0 in 0.304s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.697s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1352206619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3024d46-6e30-41cc-a522-5aed4d6ba71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56259dd9db8243a1a100e54d920f4201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:37Z,use_quota=True,user_id='a749efd36fe84b5b8c0cd9b01249d6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Creating volume f3024d46-6e30-41cc-a522-5aed4d6ba71a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:51:55 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ea89a-5d9c-4463-a66f-afdce840ab72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbea97b6-1228-4181-907c-4b2deec44e2b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:55 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a 1073741824
Nov 05 03:51:55 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6994dc75-1321-4101-8545-efff9c848021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:51:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Volume volume-cbea97b6-1228-4181-907c-4b2deec44e2b (cbea97b6-1228-4181-907c-4b2deec44e2b): created successfully
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6994dc75-1321-4101-8545-efff9c848021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Flow 'volume_create_manager' (abf12145-cb3f-4e6c-a5b4-cfb261b004c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:51:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f25894a5-7361-46be-b680-ba273393593c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Created volume successfully.
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:55 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a 1073741824" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:55 devstack sudo[100045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a
Nov 05 03:51:55 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.365s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Creating offline snapshot 6d503fb2-8dbd-4d13-b3e6-370504180aec of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Attempting download of b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume f3024d46-6e30-41cc-a522-5aed4d6ba71a. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0d4f7-9495-4cd8-b9cd-8c0210f48866]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e61a48-2a31-4642-9f17-84bf4f26ea9c]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882
Nov 05 03:51:56 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[100049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf
Nov 05 03:51:56 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882" returned: 0 in 0.510s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:56 devstack sudo[100058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec 1G
Nov 05 03:51:56 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf
Nov 05 03:51:56 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:56 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf" returned: 1 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_b6wfmkhf' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[942d9320-c5c3-4fd0-bf1b-67a4018f3254]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:57 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD
Nov 05 03:51:57 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:57 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec 1G" returned: 0 in 0.544s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:57 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:51:57 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:57 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] b168d99d-9565-4249-9e41-af4fab9708fb was qcow2, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:57 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a
Nov 05 03:51:57 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:57 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:57 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec is being set with open permissions: ugo+rw
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:57 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:51:57 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:57 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:58 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info
Nov 05 03:51:58 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Acquiring lock "cinder-cbea97b6-1228-4181-907c-4b2deec44e2b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "cinder-cbea97b6-1228-4181-907c-4b2deec44e2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:58 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info" returned: 0 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:58 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info is being set with open permissions: ugo+rw
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:58 devstack sudo[100094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info
Nov 05 03:51:58 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Acquiring lock "cinder-quobyte-cbea97b6-1228-4181-907c-4b2deec44e2b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "cinder-quobyte-cbea97b6-1228-4181-907c-4b2deec44e2b" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c9c83d-ba56-4d29-9ebc-f0faa76410c8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:58 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b
Nov 05 03:51:58 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:58 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.info" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.871s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.602s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d1b5f-ab8d-4e5c-945e-2ea744488f22]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4e63ea92-9221-44a8-9173-ee66bb4e4459 tempest-SnapshotsActionsTest-675907272 None] Create snapshot completed successfully
Nov 05 03:51:59 devstack sudo[100099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:51:59 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:59 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack sudo[100104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b
Nov 05 03:51:59 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:59 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.553s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:59 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cbea97b6-1228-4181-907c-4b2deec44e2b" returned: 0 in 0.317s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f985376-526c-4366-bc7e-99df50adcc4e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "cinder-quobyte-cbea97b6-1228-4181-907c-4b2deec44e2b" released by "delete_volume" :: held 0.918s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Created reservations ['aa4e23dc-2b81-449c-82ac-55b0ec8967aa', 'a3638228-c08d-4dd5-99fa-831e441fd2c2', 'c0832653-7954-481f-b5fe-72585112ae0a', 'a3c4b469-4a4c-4997-bd9d-06788f963090'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:51:59 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:51:59 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:51:59 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:51:59 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:51:59 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a" returned: 0 in 2.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_n2nvh_fpdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:51:59 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Converted 112.00 MB image at 44.28 MB/s
Nov 05 03:51:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:00 devstack sudo[100117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a 1G
Nov 05 03:52:00 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:00 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.498s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:00 devstack sudo[100120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img
Nov 05 03:52:00 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:00 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Deleted volume successfully.
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fd3f17e0-5a85-4ebd-8e7a-de70324c7a6c tempest-VolumeQuotasNegativeTestJSON-1598728456 None] Lock "cinder-cbea97b6-1228-4181-907c-4b2deec44e2b-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:00 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a 1G" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Downloaded image b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume f3024d46-6e30-41cc-a522-5aed4d6ba71a successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb for user a749efd36fe84b5b8c0cd9b01249d6f2 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Marking volume f3024d46-6e30-41cc-a522-5aed4d6ba71a as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Copying metadata from image b168d99d-9565-4249-9e41-af4fab9708fb to f3024d46-6e30-41cc-a522-5aed4d6ba71a. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Creating volume glance metadata for volume f3024d46-6e30-41cc-a522-5aed4d6ba71a backed by image b168d99d-9565-4249-9e41-af4fab9708fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cf9e03-5790-4240-8ba5-b31524c241a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b73503c7a0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5086332-5239-4abb-9292-10de1553087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Volume volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a (f3024d46-6e30-41cc-a522-5aed4d6ba71a): created successfully
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5086332-5239-4abb-9292-10de1553087f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Flow 'volume_create_manager' (56f64c35-3368-4741-b6c0-ed751f5d212c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e5e47ee0-690c-4700-a80a-4c30c1827c53 tempest-TestShelveInstance-439626377 None] Created volume successfully.
Nov 05 03:52:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-6ea090c5-ed18-4b00-ab0f-4605428df12a req-ccc02e42-fe85-46dc-af0b-529e3117bcdd tempest-TestShelveInstance-439626377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:08 devstack sudo[100159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:52:08 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:09 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img" returned: 0 in 8.941s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24cf4c-8c3a-4f40-946a-75da4ee0793b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:09 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:52:09 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:09 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:52:09 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.655s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:52:09 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Converted 1024.00 MB image at 114.50 MB/s
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] 7b0f6de6-eb33-445c-941b-cb74c999a182 was raw, converting to qcow2 {{(pid=87098) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f3cf4-d347-4c5e-a7f1-bc311dd59bd5]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:09 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img
Nov 05 03:52:09 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img
Nov 05 03:52:10 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img" returned: 1 in 0.422s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5
Nov 05 03:52:10 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:10 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Image conversion details: src /opt/stack/data/cinder/conversion/e9261c9a-dfac-4677-8def-b7dea4a80877.temp_image.7b0f6de6-eb33-445c-941b-cb74c999a182pzpwu_z8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:52:10 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7cf692-af11-49fd-a6ff-782fefdddef6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:10 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5
Nov 05 03:52:11 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:11 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8pxpfqn5" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.989s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Uploaded volume to glance image-id: 7b0f6de6-eb33-445c-941b-cb74c999a182. {{(pid=87098) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}}
Nov 05 03:52:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.738s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Creating offline snapshot 0ffb946c-a9ba-4426-93e0-f138fd4054ca of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c3ffa2ed-e23a-42bc-bedb-5817c894d5ba tempest-VolumesActionsTest-313682368 None] Copy volume to image completed successfully.
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae800a7-fb01-4d3f-a9df-1cbf5eb2e175]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:13 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:13 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:13 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:13 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca 1G
Nov 05 03:52:13 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Flow 'volume_create_manager' (55fa7816-1d05-4df9-a757-c44a61182ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e791bc40-d0ec-4e06-8e85-e918abbe63a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e791bc40-d0ec-4e06-8e85-e918abbe63a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2001104591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bcb2f7-0d6d-454f-8e46-c083468afc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414a73a04504c4ea520ec98aa8ee3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:14Z,use_quota=True,user_id='bf48c10b47f14af19adef0702a9f7af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8a8286-ff4c-4d3d-aa00-86e9a451d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8a8286-ff4c-4d3d-aa00-86e9a451d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad7adba-37e6-476d-86d6-03a593d41726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad7adba-37e6-476d-86d6-03a593d41726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bcb2f7-0d6d-454f-8e46-c083468afc92', 'volume_name': 'volume-59bcb2f7-0d6d-454f-8e46-c083468afc92', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd6c422-53bb-436f-83de-a95a85b8e4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd6c422-53bb-436f-83de-a95a85b8e4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2b03f3-3a4a-4b34-b520-ce9396b76415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:14 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Volume 59bcb2f7-0d6d-454f-8e46-c083468afc92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bcb2f7-0d6d-454f-8e46-c083468afc92', 'volume_size': 1}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:14 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca 1G" returned: 0 in 0.620s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:14 devstack sudo[100199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca
Nov 05 03:52:14 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Acquiring lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:14 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca" returned: 0 in 0.487s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:14 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca is being set with open permissions: ugo+rw
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:14 devstack sudo[100205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca
Nov 05 03:52:14 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Acquiring lock "cinder-quobyte-e9261c9a-dfac-4677-8def-b7dea4a80877" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Lock "cinder-quobyte-e9261c9a-dfac-4677-8def-b7dea4a80877" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a34581-2682-4710-8555-bc0c5541ea71]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:14 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:52:14 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:14 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-6ea090c5-ed18-4b00-ab0f-4605428df12a req-ccc02e42-fe85-46dc-af0b-529e3117bcdd tempest-TestShelveInstance-439626377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-6ea090c5-ed18-4b00-ab0f-4605428df12a req-ccc02e42-fe85-46dc-af0b-529e3117bcdd tempest-TestShelveInstance-439626377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2001104591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bcb2f7-0d6d-454f-8e46-c083468afc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414a73a04504c4ea520ec98aa8ee3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:14Z,use_quota=True,user_id='bf48c10b47f14af19adef0702a9f7af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Creating volume 59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-790b49a6-025f-49b2-83cd-9282b919d0e0 tempest-SnapshotsActionsTest-675907272 None] Create snapshot completed successfully
Nov 05 03:52:15 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 1073741824
Nov 05 03:52:15 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-6ea090c5-ed18-4b00-ab0f-4605428df12a req-ccc02e42-fe85-46dc-af0b-529e3117bcdd tempest-TestShelveInstance-439626377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58cdabbe-1c7c-4222-bcc5-a27fff049779', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:52:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-6ea090c5-ed18-4b00-ab0f-4605428df12a req-ccc02e42-fe85-46dc-af0b-529e3117bcdd tempest-TestShelveInstance-439626377 None] attachment_update completed successfully.
Nov 05 03:52:15 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:15 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877
Nov 05 03:52:15 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-0ffb946c-a9ba-4426-93e0-f138fd4054ca-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-0ffb946c-a9ba-4426-93e0-f138fd4054ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-0ffb946c-a9ba-4426-93e0-f138fd4054ca" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-0ffb946c-a9ba-4426-93e0-f138fd4054ca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Deleting offline snapshot 0ffb946c-a9ba-4426-93e0-f138fd4054ca of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:15 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] snapshot_file for this snap is: volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e9261c9a-dfac-4677-8def-b7dea4a80877" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6753486-22a8-410a-a990-531d2bbf7450]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Lock "cinder-quobyte-e9261c9a-dfac-4677-8def-b7dea4a80877" released by "delete_volume" :: held 1.026s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:15 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 1073741824" returned: 0 in 0.780s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Created reservations ['08f0f83e-303c-40f9-80fc-17de5f0bb964', 'd794c3a1-22ca-4deb-b965-389136ee1160', '5db8b5a4-6610-4f9e-8fdd-e98a7838b584', 'd9bbb05b-6fa0-4c89-815c-10521993da8c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:15 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca
Nov 05 03:52:15 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:15 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92
Nov 05 03:52:15 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:16 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:52:16 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:16 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92" returned: 0 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2b03f3-3a4a-4b34-b520-ce9396b76415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bcb2f7-0d6d-454f-8e46-c083468afc92', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81cda04-6ad0-4e15-9666-397f3c5b2068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:16 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca" returned: 0 in 0.692s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Volume volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 (59bcb2f7-0d6d-454f-8e46-c083468afc92): created successfully
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81cda04-6ad0-4e15-9666-397f3c5b2068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Flow 'volume_create_manager' (55fa7816-1d05-4df9-a757-c44a61182ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7bec571c-c461-49a1-b261-4184cda74237 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Created volume successfully.
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8fb916-e286-4dd5-8a73-8a5e58c8a982]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:16 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Deleted volume successfully.
Nov 05 03:52:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-544b5cfd-9af0-42de-b320-1720b0258938 tempest-VolumesActionsTest-313682368 None] Lock "cinder-e9261c9a-dfac-4677-8def-b7dea4a80877-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:16 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:16 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:17 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.732s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:17 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca
Nov 05 03:52:17 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Creating offline snapshot a93566d1-cfbc-4509-94f4-ef6928bfce03 of volume 59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a3a70-61f4-4995-b83d-a3ac7f9ffa33]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:18 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92
Nov 05 03:52:18 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:18 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca" returned: 0 in 0.960s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:18 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca
Nov 05 03:52:18 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:18 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92" returned: 0 in 0.566s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:18 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.0ffb946c-a9ba-4426-93e0-f138fd4054ca" returned: 0 in 0.428s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:18 devstack sudo[100732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 1G
Nov 05 03:52:18 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-0ffb946c-a9ba-4426-93e0-f138fd4054ca" released by "_delete_snapshot" :: held 3.108s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" released by "delete_snapshot" :: held 3.147s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Created reservations ['fef67102-cdbf-4295-a9db-87233c426d44', 'aff6d462-a8a8-4eb7-ab9c-3b1006959727', '9c28c34b-0341-4b38-b7e2-d38a1d5f0b24', '50fbe294-0951-45eb-8af8-4019fc9d2168'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Delete snapshot completed successfully.
Nov 05 03:52:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd3bcee3-1ef6-4da8-bfe8-559935bcef83 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-0ffb946c-a9ba-4426-93e0-f138fd4054ca-delete_snapshot" released by "delete_snapshot" :: held 3.562s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:19 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 1G" returned: 0 in 0.984s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:19 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03
Nov 05 03:52:19 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03" returned: 0 in 0.703s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 is being set with open permissions: ugo+rw
Nov 05 03:52:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:20 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03
Nov 05 03:52:20 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:20 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:20 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info
Nov 05 03:52:20 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:21 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info is being set with open permissions: ugo+rw
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:21 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info
Nov 05 03:52:21 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:21 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.info" returned: 0 in 0.383s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.769s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.207s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Creating offline snapshot e182761e-716d-4d1e-bf4d-a97365550711 of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c850b15d-60ee-4194-b3aa-e7548cbcf0c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Create snapshot completed successfully
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f060378-2953-496d-b91d-49a13ab3c252]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:22 devstack sudo[100753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:22 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:22 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.758s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:22 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 1G
Nov 05 03:52:22 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "cinder-a93566d1-cfbc-4509-94f4-ef6928bfce03-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-a93566d1-cfbc-4509-94f4-ef6928bfce03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "cinder-quobyte-59bcb2f7-0d6d-454f-8e46-c083468afc92" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-quobyte-59bcb2f7-0d6d-454f-8e46-c083468afc92" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "cinder-quobyte-a93566d1-cfbc-4509-94f4-ef6928bfce03" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-quobyte-a93566d1-cfbc-4509-94f4-ef6928bfce03" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Deleting offline snapshot a93566d1-cfbc-4509-94f4-ef6928bfce03 of volume 59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] snapshot_file for this snap is: volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f48882-136a-4cea-9c15-1130207d83ec]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:23 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03
Nov 05 03:52:23 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:23 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 1G" returned: 0 in 1.017s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:23 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711
Nov 05 03:52:23 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:24 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03" returned: 0 in 0.891s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bcb2f7-0d6d-454f-8e46-c083468afc92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b571ba8-1ce0-44b0-9dc8-d94ff1767d2d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:24 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711" returned: 0 in 0.771s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:24 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 is being set with open permissions: ugo+rw
Nov 05 03:52:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:24 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711
Nov 05 03:52:24 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:24 devstack sudo[100778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92
Nov 05 03:52:24 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:25 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711" returned: 0 in 0.699s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.459s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c07a20c7-8ec6-4b9a-89ab-86e15f9bc5fc tempest-SnapshotsActionsTest-675907272 None] Create snapshot completed successfully
Nov 05 03:52:25 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92" returned: 0 in 1.077s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:25 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03
Nov 05 03:52:25 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03" returned: 0 in 0.755s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:26 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03
Nov 05 03:52:26 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-e182761e-716d-4d1e-bf4d-a97365550711-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-e182761e-716d-4d1e-bf4d-a97365550711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-e182761e-716d-4d1e-bf4d-a97365550711" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-e182761e-716d-4d1e-bf4d-a97365550711" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Deleting offline snapshot e182761e-716d-4d1e-bf4d-a97365550711 of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] snapshot_file for this snap is: volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2547586-03b2-4821-bdbd-82f111714c47]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:26 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92.a93566d1-cfbc-4509-94f4-ef6928bfce03" returned: 0 in 0.438s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-quobyte-a93566d1-cfbc-4509-94f4-ef6928bfce03" released by "_delete_snapshot" :: held 3.459s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-quobyte-59bcb2f7-0d6d-454f-8e46-c083468afc92" released by "delete_snapshot" :: held 3.496s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:26 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711
Nov 05 03:52:26 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Created reservations ['3e0fc532-aa80-449b-bd1a-e8f38ea2084c', '52aad3dc-aa02-488c-baa8-a7a5dc39f7d4', '5c286385-dd3f-4d08-a5d0-83aed5d2e211', 'c4818ce0-c29f-4b1d-b62e-032ecd5b4125'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Delete snapshot completed successfully.
Nov 05 03:52:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-89e7a73c-1bfb-4d6d-bf84-c220f90b8cab tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-a93566d1-cfbc-4509-94f4-ef6928bfce03-delete_snapshot" released by "delete_snapshot" :: held 3.817s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:27 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711" returned: 0 in 0.652s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d1857-601d-4d06-987f-3a83838f451e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:27 devstack sudo[100803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:27 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "cinder-59bcb2f7-0d6d-454f-8e46-c083468afc92-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:27 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-59bcb2f7-0d6d-454f-8e46-c083468afc92-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.564s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:27 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711
Nov 05 03:52:27 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "cinder-quobyte-59bcb2f7-0d6d-454f-8e46-c083468afc92" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-quobyte-59bcb2f7-0d6d-454f-8e46-c083468afc92" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7009d-2521-4e91-8069-02a18a7e3515]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:28 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92
Nov 05 03:52:28 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:28 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711" returned: 0 in 0.633s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:28 devstack sudo[100819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711
Nov 05 03:52:28 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:28 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:28 devstack sudo[100822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92
Nov 05 03:52:28 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:28 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.e182761e-716d-4d1e-bf4d-a97365550711" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-e182761e-716d-4d1e-bf4d-a97365550711" released by "_delete_snapshot" :: held 2.430s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" released by "delete_snapshot" :: held 2.491s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:28 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59bcb2f7-0d6d-454f-8e46-c083468afc92" returned: 0 in 0.371s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-quobyte-59bcb2f7-0d6d-454f-8e46-c083468afc92" released by "delete_volume" :: held 1.004s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Created reservations ['55f10868-6c61-4eb0-b08d-42c374586115', 'eac7ef47-0ccd-44e1-a184-29094e9ddcae', '44bad557-250c-4743-9dc8-5d7aa5fb97f2', '6a72627c-aed6-4dec-b6ff-4fea353a6c8e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Created reservations ['705a4e33-714e-46d0-8dc6-5b61d3e4e5f7', 'f4495fe2-87ed-4d1d-a424-bbf84c402695', '9c09d2d1-1f10-4e16-94f0-b7d72ef5e2f3', 'b8e1672c-29df-4d00-89d3-42043738124a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Delete snapshot completed successfully.
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2cc4f07b-6f2b-4f59-b15a-d04a15fffe0a tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-e182761e-716d-4d1e-bf4d-a97365550711-delete_snapshot" released by "delete_snapshot" :: held 2.826s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:29 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:52:29 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:29 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Deleted volume successfully.
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4a05acaf-6065-4346-bc79-f7b490ae8374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1692713054 None] Lock "cinder-59bcb2f7-0d6d-454f-8e46-c083468afc92-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Creating offline snapshot 7e4d353f-5668-4c10-a104-bd49939eef7f of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a291fc76-d9ac-4519-8f08-45af17e2bd0f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:30 devstack sudo[100829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:30 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:30 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.660s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:30 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f 1G
Nov 05 03:52:30 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:31 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f 1G" returned: 0 in 0.794s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:31 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f
Nov 05 03:52:31 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:32 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f is being set with open permissions: ugo+rw
Nov 05 03:52:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:32 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f
Nov 05 03:52:32 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:32 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9864caba-0f0b-4a6a-acb4-850b286cdc48 tempest-SnapshotsActionsTest-675907272 None] Create snapshot completed successfully
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-7e4d353f-5668-4c10-a104-bd49939eef7f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-7e4d353f-5668-4c10-a104-bd49939eef7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-7e4d353f-5668-4c10-a104-bd49939eef7f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-7e4d353f-5668-4c10-a104-bd49939eef7f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Deleting offline snapshot 7e4d353f-5668-4c10-a104-bd49939eef7f of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] snapshot_file for this snap is: volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e014af54-8c6d-4ce1-a2b1-b95f3992f12a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:33 devstack sudo[100848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f
Nov 05 03:52:33 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:34 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f" returned: 0 in 0.636s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e52b7-b091-48b8-bfee-b0312f6ebea6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:34 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:34 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:34 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:34 devstack sudo[100858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f
Nov 05 03:52:34 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:35 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f" returned: 0 in 0.686s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:35 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f
Nov 05 03:52:35 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:36 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.7e4d353f-5668-4c10-a104-bd49939eef7f" returned: 0 in 0.514s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-7e4d353f-5668-4c10-a104-bd49939eef7f" released by "_delete_snapshot" :: held 2.593s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" released by "delete_snapshot" :: held 2.636s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Created reservations ['2ded31b3-0e3d-4901-ba2c-bb2dd1482ce2', '7d986194-9ea0-4cd9-b269-28d686a5f50f', '0c4eb96b-f7af-4638-a52c-d6bc8efb810f', '649b3c0a-2d9c-48b2-8257-bbcd79b123ed'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Delete snapshot completed successfully.
Nov 05 03:52:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6f7e491a-933a-4dcd-ad52-b783a311ea40 tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-7e4d353f-5668-4c10-a104-bd49939eef7f-delete_snapshot" released by "delete_snapshot" :: held 2.945s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Creating offline snapshot c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fc3c31-acb1-46c6-8d1a-a140ac864526]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:37 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:37 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:38 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.748s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:38 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f 1G
Nov 05 03:52:38 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:38 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f 1G" returned: 0 in 0.725s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:38 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f
Nov 05 03:52:38 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:39 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" returned: 0 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:39 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f is being set with open permissions: ugo+rw
Nov 05 03:52:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:39 devstack sudo[100921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f
Nov 05 03:52:39 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:39 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" returned: 0 in 0.350s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ecc54d88-7c1b-486e-b9ba-3e06b74dbae4 tempest-SnapshotsActionsTest-675907272 None] Create snapshot completed successfully
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Acquiring lock "cinder-quobyte-c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Deleting offline snapshot c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] snapshot_file for this snap is: volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e750490-2dab-48f1-bf5e-1b5481061833]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:41 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f
Nov 05 03:52:41 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:41 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" returned: 0 in 0.659s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f30a367-6c44-4867-9348-50be7c0053e5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:41 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:41 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:42 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.536s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:42 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f
Nov 05 03:52:42 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:42 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" returned: 0 in 0.538s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:42 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f
Nov 05 03:52:42 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:43 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" returned: 0 in 0.338s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f" released by "_delete_snapshot" :: held 2.262s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" released by "delete_snapshot" :: held 2.302s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Created reservations ['eb115da0-672a-4a6f-b74f-974969c1cbb4', '77529db3-2371-470c-94b4-2b4fe9cef784', '47bd21d7-a984-4c67-9a69-2ea1c425437e', '3cfd95ae-278d-41df-8118-a18d7580fc3a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Delete snapshot completed successfully.
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3db0766d-ebd9-4c52-8b92-968865e66b5d tempest-SnapshotsActionsTest-1442296575 None] Lock "cinder-c97cba38-c3c8-4fc1-8f36-e4ac49e9ed8f-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Flow 'volume_create_manager' (de10cdf4-36b2-4290-a1b7-285c9ba7d40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73365a0e-5ef6-46da-93ac-6ceca3ba117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73365a0e-5ef6-46da-93ac-6ceca3ba117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-502997814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f780e1a-e1d2-4351-9300-8c9888f329fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91af4a5b4a4ef3b0e464422a420344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:44Z,use_quota=True,user_id='722363829aaf4dcb96e015d34be8756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49def430-9dd8-47e4-a5fa-679cad2e7d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49def430-9dd8-47e4-a5fa-679cad2e7d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1ef061-999e-4479-bdca-f9a8ee16fc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1ef061-999e-4479-bdca-f9a8ee16fc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f780e1a-e1d2-4351-9300-8c9888f329fa', 'volume_name': 'volume-4f780e1a-e1d2-4351-9300-8c9888f329fa', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1f2ff9-82b9-4751-946c-11188c97935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1f2ff9-82b9-4751-946c-11188c97935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83aff67-3e8e-4ec4-98ff-1b251ecae443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Volume 4f780e1a-e1d2-4351-9300-8c9888f329fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f780e1a-e1d2-4351-9300-8c9888f329fa', 'volume_size': 1}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-502997814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f780e1a-e1d2-4351-9300-8c9888f329fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91af4a5b4a4ef3b0e464422a420344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:44Z,use_quota=True,user_id='722363829aaf4dcb96e015d34be8756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Creating volume 4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:52:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:43 devstack sudo[100946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa 1073741824
Nov 05 03:52:43 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:44 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa 1073741824" returned: 0 in 0.607s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:44 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa
Nov 05 03:52:44 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:44 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "cinder-6d503fb2-8dbd-4d13-b3e6-370504180aec-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-6d503fb2-8dbd-4d13-b3e6-370504180aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83aff67-3e8e-4ec4-98ff-1b251ecae443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f780e1a-e1d2-4351-9300-8c9888f329fa', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0433ddca-68d3-40e5-bf2e-2a1358d2a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "cinder-quobyte-6d503fb2-8dbd-4d13-b3e6-370504180aec" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Volume volume-4f780e1a-e1d2-4351-9300-8c9888f329fa (4f780e1a-e1d2-4351-9300-8c9888f329fa): created successfully
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0433ddca-68d3-40e5-bf2e-2a1358d2a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Flow 'volume_create_manager' (de10cdf4-36b2-4290-a1b7-285c9ba7d40e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-quobyte-6d503fb2-8dbd-4d13-b3e6-370504180aec" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Deleting offline snapshot 6d503fb2-8dbd-4d13-b3e6-370504180aec of volume 588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] snapshot_file for this snap is: volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-638d558c-7518-44a3-b442-e61a50c6324e tempest-VolumesDeleteCascade-974177236 None] Created volume successfully.
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d95de5-0be0-4735-b5d0-da786abba799]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:45 devstack sudo[100955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:45 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:45 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.444s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-588ad5dd-671e-4ab5-a9b8-b86797d36882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee43ab9-3e81-4e11-9f31-8d16be267c77]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:45 devstack sudo[100960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882
Nov 05 03:52:45 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:45 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882" returned: 0 in 0.532s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:45 devstack sudo[100965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:45 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Creating offline snapshot 5224692f-9c9d-4baf-afb4-9e4553ed6c48 of volume 4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a1fc22-4ac1-430c-a0a3-a2572cb995c8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:46 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa
Nov 05 03:52:46 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:46 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.573s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:46 devstack sudo[100973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec
Nov 05 03:52:46 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:46 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa" returned: 0 in 0.715s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:46 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 1G
Nov 05 03:52:46 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:47 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882.6d503fb2-8dbd-4d13-b3e6-370504180aec" returned: 0 in 0.565s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-quobyte-6d503fb2-8dbd-4d13-b3e6-370504180aec" released by "_delete_snapshot" :: held 2.324s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" released by "delete_snapshot" :: held 2.376s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Created reservations ['359a7b0a-dd09-4193-ab23-b4844914bab2', '592f845d-bfc8-4102-922b-c163b8840d65', '733ecc2f-4ad4-4c15-9397-875a7012ff0e', 'aea768fa-b76e-4e42-a1a6-e84df4a9a240'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Delete snapshot completed successfully.
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-01897a5f-0939-45b8-8993-34ea2a404ba4 tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-6d503fb2-8dbd-4d13-b3e6-370504180aec-delete_snapshot" released by "delete_snapshot" :: held 2.750s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:47 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 1G" returned: 0 in 0.883s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f780e1a-e1d2-4351-9300-8c9888f329fa -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:47 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f780e1a-e1d2-4351-9300-8c9888f329fa -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:47 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:48 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f780e1a-e1d2-4351-9300-8c9888f329fa -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:48 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 is being set with open permissions: ugo+rw
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:48 devstack sudo[100991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:48 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "cinder-588ad5dd-671e-4ab5-a9b8-b86797d36882-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-588ad5dd-671e-4ab5-a9b8-b86797d36882-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31a357-4d03-4f18-b1f1-695256a4bb7b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:48 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:48 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882
Nov 05 03:52:48 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:48 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info
Nov 05 03:52:48 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:48 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info" returned: 0 in 0.360s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:48 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info is being set with open permissions: ugo+rw
Nov 05 03:52:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:49 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info
Nov 05 03:52:49 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (67731cf0-2087-4a9d-aaee-32d2a588c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc99756-0d07-4620-8fdc-5613a9210261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:49 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc99756-0d07-4620-8fdc-5613a9210261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1282291718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834db3f5-548b-4d61-aeb8-2f8016d59993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:49Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb9c3c0-f1a4-49e6-a1e2-d100fb6f740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb9c3c0-f1a4-49e6-a1e2-d100fb6f740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76d4f9-302b-43c7-8c08-1efa9be33d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76d4f9-302b-43c7-8c08-1efa9be33d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834db3f5-548b-4d61-aeb8-2f8016d59993', 'volume_name': 'volume-834db3f5-548b-4d61-aeb8-2f8016d59993', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248cec4a-46d4-4277-ba3a-b2a033e9c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248cec4a-46d4-4277-ba3a-b2a033e9c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405615bd-ae22-4314-87bc-21453eb933ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume 834db3f5-548b-4d61-aeb8-2f8016d59993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834db3f5-548b-4d61-aeb8-2f8016d59993', 'volume_size': 1}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882" returned: 0 in 0.635s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:49 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882
Nov 05 03:52:49 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:49 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.info" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.350s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1282291718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834db3f5-548b-4d61-aeb8-2f8016d59993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:49Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating volume 834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:49 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=98,cinder:UPDATE=89,cinder:DELETE=9,cinder:INSERT=26 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:52:49 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 1073741824
Nov 05 03:52:49 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=88,cinder:UPDATE=79,cinder:INSERT=30,cinder:DELETE=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:52:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e86c9d9b-b460-4c0b-81f9-ddb6b1eeecc9 tempest-VolumesDeleteCascade-974177236 None] Create snapshot completed successfully
Nov 05 03:52:49 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-588ad5dd-671e-4ab5-a9b8-b86797d36882" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-quobyte-588ad5dd-671e-4ab5-a9b8-b86797d36882" released by "delete_volume" :: held 1.120s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Created reservations ['8d5a4512-a516-47dc-b699-04a3227caf71', '6762701a-bf55-4067-af49-6edcb470035b', 'e32f30f7-717b-49f8-8cef-743505c2ef99', 'b02ebb81-401e-48ab-9f6a-b13e11982a0d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:49 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:52:49 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:50 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:50 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 1073741824" returned: 0 in 0.621s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Deleted volume successfully.
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad021ede-ea59-4f2b-90e6-8c5e3b2576dd tempest-SnapshotsActionsTest-675907272 None] Lock "cinder-588ad5dd-671e-4ab5-a9b8-b86797d36882-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:50 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993
Nov 05 03:52:50 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:50 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405615bd-ae22-4314-87bc-21453eb933ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834db3f5-548b-4d61-aeb8-2f8016d59993', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746d1e4e-0b1b-4768-ba6c-4a8ea41ce726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume volume-834db3f5-548b-4d61-aeb8-2f8016d59993 (834db3f5-548b-4d61-aeb8-2f8016d59993): created successfully
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746d1e4e-0b1b-4768-ba6c-4a8ea41ce726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (67731cf0-2087-4a9d-aaee-32d2a588c021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6777afed-f401-4fe7-acf2-47ebf866dc90 tempest-VolumesSnapshotTestJSON-1720905235 None] Created volume successfully.
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Creating offline snapshot 483d1a6e-a77e-4cfc-8eb4-37601264d50e of volume 4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e347298-06d2-47ee-8388-90bf90a32dee]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:50 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:50 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:51 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f780e1a-e1d2-4351-9300-8c9888f329fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:51 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e 1G
Nov 05 03:52:51 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:51 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e 1G" returned: 0 in 0.684s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:51 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e
Nov 05 03:52:51 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:52 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e is being set with open permissions: ugo+rw
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:52 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e
Nov 05 03:52:52 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:52 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e" returned: 0 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.625s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating offline snapshot cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 of volume 834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:52:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6565a6c1-85bb-4a79-8141-87e5ecbbe502 tempest-VolumesDeleteCascade-974177236 None] Create snapshot completed successfully
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c0c73-5ebe-4357-9ef6-195ec091a5b2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:52 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993
Nov 05 03:52:52 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:53 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:53 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 1G
Nov 05 03:52:53 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:53 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 1G" returned: 0 in 0.562s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-834db3f5-548b-4d61-aeb8-2f8016d59993 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:53 devstack sudo[101056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-834db3f5-548b-4d61-aeb8-2f8016d59993 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4
Nov 05 03:52:53 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-4f780e1a-e1d2-4351-9300-8c9888f329fa-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-4f780e1a-e1d2-4351-9300-8c9888f329fa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Performing cascade delete. {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-483d1a6e-a77e-4cfc-8eb4-37601264d50e-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-483d1a6e-a77e-4cfc-8eb4-37601264d50e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-483d1a6e-a77e-4cfc-8eb4-37601264d50e" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-483d1a6e-a77e-4cfc-8eb4-37601264d50e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Deleting offline snapshot 483d1a6e-a77e-4cfc-8eb4-37601264d50e of volume 4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] snapshot_file for this snap is: volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8c53ce-a334-47bf-8336-7d4ea2a8afdf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:54 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-834db3f5-548b-4d61-aeb8-2f8016d59993 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:54 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 is being set with open permissions: ugo+rw
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:54 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e
Nov 05 03:52:54 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:54 devstack sudo[101062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4
Nov 05 03:52:54 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:54 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:54 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f780e1a-e1d2-4351-9300-8c9888f329fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:54 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info
Nov 05 03:52:54 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527bc60-aa5c-44ba-95c3-fd13e7c4e1b9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:54 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:54 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:54 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:54 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info is being set with open permissions: ugo+rw
Nov 05 03:52:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:54 devstack sudo[101074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info
Nov 05 03:52:54 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:55 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:55 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.info" returned: 0 in 0.304s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.591s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f780e1a-e1d2-4351-9300-8c9888f329fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:55 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e
Nov 05 03:52:55 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-77b18d4b-cb00-4f3a-bf21-1e864bc8d4d5 tempest-VolumesSnapshotTestJSON-1720905235 None] Create snapshot completed successfully
Nov 05 03:52:55 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e" returned: 0 in 0.481s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:55 devstack sudo[101122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e
Nov 05 03:52:55 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:55 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.483d1a6e-a77e-4cfc-8eb4-37601264d50e" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-483d1a6e-a77e-4cfc-8eb4-37601264d50e" released by "_delete_snapshot" :: held 1.976s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" released by "delete_snapshot" :: held 2.006s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Created reservations ['4266a920-915e-457d-b7dd-55d4e2c723e7', '9b00027c-e499-4ef6-aa58-b55698b4894c', '6e6812b4-0dbc-4ee6-9038-e2682d356e75', 'b14f3bb6-a948-4d63-9029-6c3eb5c16add'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Delete snapshot completed successfully.
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-483d1a6e-a77e-4cfc-8eb4-37601264d50e-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-5224692f-9c9d-4baf-afb4-9e4553ed6c48-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-5224692f-9c9d-4baf-afb4-9e4553ed6c48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-5224692f-9c9d-4baf-afb4-9e4553ed6c48" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-5224692f-9c9d-4baf-afb4-9e4553ed6c48" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Deleting offline snapshot 5224692f-9c9d-4baf-afb4-9e4553ed6c48 of volume 4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] snapshot_file for this snap is: volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c46c5bc-9233-4e47-a2fc-3ccd33bd61cb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:56 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:56 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-cc3e0f8a-7a60-41de-9227-e7d8d0d091e4-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-cc3e0f8a-7a60-41de-9227-e7d8d0d091e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-834db3f5-548b-4d61-aeb8-2f8016d59993" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-834db3f5-548b-4d61-aeb8-2f8016d59993" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Deleting offline snapshot cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 of volume 834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] snapshot_file for this snap is: volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e02f61-fdb4-4163-b161-83c54923d22d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:56 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f780e1a-e1d2-4351-9300-8c9888f329fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:56 devstack sudo[101127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4
Nov 05 03:52:56 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a45f2-0918-44da-a2be-f1497f1657dc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:56 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa
Nov 05 03:52:56 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:57 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" returned: 0 in 0.482s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-834db3f5-548b-4d61-aeb8-2f8016d59993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de23a4-db16-4d58-bfe4-457ca8d103ad]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:57 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:57 devstack sudo[101142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:57 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:57 devstack sudo[101140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993
Nov 05 03:52:57 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:57 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993" returned: 0 in 0.549s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:57 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4
Nov 05 03:52:57 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:57 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:57 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48
Nov 05 03:52:57 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:58 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa.5224692f-9c9d-4baf-afb4-9e4553ed6c48" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:58 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-5224692f-9c9d-4baf-afb4-9e4553ed6c48" released by "_delete_snapshot" :: held 1.953s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" released by "delete_snapshot" :: held 1.990s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:58 devstack sudo[101161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4
Nov 05 03:52:58 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Created reservations ['b3565b90-2189-432e-b8b2-f711a18cba65', 'b667924b-7fbc-4dd8-82cc-7539c0727401', '12fc76b6-b48e-4656-bcf3-588fec1a80e2', '72f05c4f-d39a-45b9-a9ce-ff5a5c725e07'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Delete snapshot completed successfully.
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-5224692f-9c9d-4baf-afb4-9e4553ed6c48-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Snapshots deleted, issuing volume delete {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d173d-b879-4937-943b-9111f5eeca23]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:58 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993.cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-cc3e0f8a-7a60-41de-9227-e7d8d0d091e4" released by "_delete_snapshot" :: held 1.968s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-834db3f5-548b-4d61-aeb8-2f8016d59993" released by "delete_snapshot" :: held 1.994s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['4e150f9b-2fab-43d3-af8c-f9cf95f36c72', '42918afe-73d5-4fff-8e36-239dfa252096', 'e4e9b3e8-3ec8-405f-ba62-929e11d07d78', 'b6c4e150-874e-4372-bacb-cb4a1a56781e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:58 devstack sudo[101164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa
Nov 05 03:52:58 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Delete snapshot completed successfully.
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7362a09-9cd4-480e-905a-723a7c461325 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-cc3e0f8a-7a60-41de-9227-e7d8d0d091e4-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:58 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:58 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa
Nov 05 03:52:58 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:59 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f780e1a-e1d2-4351-9300-8c9888f329fa" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-4f780e1a-e1d2-4351-9300-8c9888f329fa" released by "delete_volume" :: held 0.932s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Created reservations ['d20a8d8b-26fa-4316-ab04-acaf1f3f5e65', '7c126fb8-9a26-449a-bb3e-65f3be71d01e', '8297d569-f198-40d2-9cff-33276824e446', 'ed2de1ef-34ba-44e0-8878-f0ce616e7a9b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Flow 'volume_create_manager' (a57d5919-781d-4bc6-9088-5dbbd5f44ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d58529a-dc08-4ab2-807c-a6724701e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d58529a-dc08-4ab2-807c-a6724701e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-394735164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d288531-fa5f-4484-ad5e-c4bb798b933f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a25073982c4466c92ef2576a5830357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:59Z,use_quota=True,user_id='c059e8a0e2b8452f87c961d4f13822ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540e95e7-82da-42e0-991a-8b3b7d870b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540e95e7-82da-42e0-991a-8b3b7d870b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3849c75d-5fe0-48b3-be5d-401dda791316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3849c75d-5fe0-48b3-be5d-401dda791316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d288531-fa5f-4484-ad5e-c4bb798b933f', 'volume_name': 'volume-5d288531-fa5f-4484-ad5e-c4bb798b933f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319c4f45-43d8-4a73-95dd-3b32267f1ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319c4f45-43d8-4a73-95dd-3b32267f1ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222c668b-ade0-4627-b9f1-f293feb0fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:52:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Volume 5d288531-fa5f-4484-ad5e-c4bb798b933f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d288531-fa5f-4484-ad5e-c4bb798b933f', 'volume_size': 1}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-394735164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d288531-fa5f-4484-ad5e-c4bb798b933f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a25073982c4466c92ef2576a5830357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:59Z,use_quota=True,user_id='c059e8a0e2b8452f87c961d4f13822ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Creating volume 5d288531-fa5f-4484-ad5e-c4bb798b933f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:52:59 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:59 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f 1073741824
Nov 05 03:52:59 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:52:59 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:52:59 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:52:59 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:52:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Deleted volume successfully.
Nov 05 03:52:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5012028b-4570-4582-b5fd-3b0e44e2044c tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-4f780e1a-e1d2-4351-9300-8c9888f329fa-delete_volume" released by "delete_volume" :: held 6.224s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:00 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f 1073741824" returned: 0 in 0.552s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:00 devstack sudo[101180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f
Nov 05 03:53:00 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (3cce10ed-9db4-4968-9671-e49aa7e8798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df610dfa-92a4-4247-aa0f-7ce10cadecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df610dfa-92a4-4247-aa0f-7ce10cadecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2099812212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453fe161-9e00-4796-bc4c-c962629708e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:00Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b54021-53f1-4e6c-8fbc-bcbad28da538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b54021-53f1-4e6c-8fbc-bcbad28da538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:00 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678df7b3-6bb2-401e-91e8-3e4a43e64a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678df7b3-6bb2-401e-91e8-3e4a43e64a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453fe161-9e00-4796-bc4c-c962629708e3', 'volume_name': 'volume-453fe161-9e00-4796-bc4c-c962629708e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2e245a-0840-4f64-9dcf-da5157787a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2e245a-0840-4f64-9dcf-da5157787a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0100c2de-1909-409a-98e4-06380212046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume 453fe161-9e00-4796-bc4c-c962629708e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453fe161-9e00-4796-bc4c-c962629708e3', 'volume_size': 1}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2099812212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453fe161-9e00-4796-bc4c-c962629708e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:00Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating volume 453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222c668b-ade0-4627-b9f1-f293feb0fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d288531-fa5f-4484-ad5e-c4bb798b933f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:00 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 1073741824
Nov 05 03:53:00 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9c6204-5562-4efe-9eae-54cc98939418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Volume volume-5d288531-fa5f-4484-ad5e-c4bb798b933f (5d288531-fa5f-4484-ad5e-c4bb798b933f): created successfully
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9c6204-5562-4efe-9eae-54cc98939418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Flow 'volume_create_manager' (a57d5919-781d-4bc6-9088-5dbbd5f44ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fef48320-7891-41e9-9bb8-490eb73d3884 tempest-VolumeQuotasAdminTestJSON-119880458 None] Created volume successfully.
Nov 05 03:53:01 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 1073741824" returned: 0 in 0.520s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:01 devstack sudo[101190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3
Nov 05 03:53:01 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Flow 'volume_create_manager' (a05a3d23-2016-4f65-a581-9108532ea639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c13b17-1a12-4002-b06f-4f98874bee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:01 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c13b17-1a12-4002-b06f-4f98874bee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-56671505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bc3393-b51d-4446-ab06-2ea4b667c9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91af4a5b4a4ef3b0e464422a420344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:01Z,use_quota=True,user_id='722363829aaf4dcb96e015d34be8756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0756f1-7f5d-496d-b66a-c463fc1a031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0756f1-7f5d-496d-b66a-c463fc1a031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5532957a-c73c-471c-871b-cdf96a257fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5532957a-c73c-471c-871b-cdf96a257fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bc3393-b51d-4446-ab06-2ea4b667c9d0', 'volume_name': 'volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85546c5-4b49-408d-bbfc-6cbf372b9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85546c5-4b49-408d-bbfc-6cbf372b9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287f188e-7daf-47bc-b64f-55658c20662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Volume 58bc3393-b51d-4446-ab06-2ea4b667c9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0', 'volume_size': 1}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-56671505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bc3393-b51d-4446-ab06-2ea4b667c9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91af4a5b4a4ef3b0e464422a420344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:01Z,use_quota=True,user_id='722363829aaf4dcb96e015d34be8756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Creating volume 58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:01 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0100c2de-1909-409a-98e4-06380212046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453fe161-9e00-4796-bc4c-c962629708e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:01 devstack sudo[101193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 1073741824
Nov 05 03:53:01 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14ae2d6-f482-4eb7-92a5-ec8f06a7c59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume volume-453fe161-9e00-4796-bc4c-c962629708e3 (453fe161-9e00-4796-bc4c-c962629708e3): created successfully
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14ae2d6-f482-4eb7-92a5-ec8f06a7c59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (3cce10ed-9db4-4968-9671-e49aa7e8798d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a1c859c8-bb2c-4ea1-b406-f868bedd0808 tempest-VolumesSnapshotTestJSON-1720905235 None] Created volume successfully.
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "cinder-5d288531-fa5f-4484-ad5e-c4bb798b933f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "cinder-5d288531-fa5f-4484-ad5e-c4bb798b933f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "cinder-quobyte-5d288531-fa5f-4484-ad5e-c4bb798b933f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "cinder-quobyte-5d288531-fa5f-4484-ad5e-c4bb798b933f" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca7ba1-80f7-49d7-85a7-d6d969ffb8b0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:01 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f
Nov 05 03:53:01 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:02 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 1073741824" returned: 0 in 0.650s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:02 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0
Nov 05 03:53:02 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:02 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f" returned: 0 in 0.601s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:02 devstack sudo[101213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f
Nov 05 03:53:02 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:02 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0" returned: 0 in 0.505s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287f188e-7daf-47bc-b64f-55658c20662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851224d0-a6b0-457f-91bc-fe40ef3e021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Volume volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 (58bc3393-b51d-4446-ab06-2ea4b667c9d0): created successfully
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851224d0-a6b0-457f-91bc-fe40ef3e021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Flow 'volume_create_manager' (a05a3d23-2016-4f65-a581-9108532ea639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-84e0987e-b5b9-46db-9782-0256dc832b78 tempest-VolumesDeleteCascade-974177236 None] Created volume successfully.
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating offline snapshot cc47cdc8-a3da-49f4-8906-a84f353ff526 of volume 453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b2b4c-73e2-4165-99e4-584c9a4602ab]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:02 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d288531-fa5f-4484-ad5e-c4bb798b933f" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "cinder-quobyte-5d288531-fa5f-4484-ad5e-c4bb798b933f" released by "delete_volume" :: held 1.213s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Created reservations ['5fe04830-9f20-4900-b2fe-1f4e36871a60', 'd55ac59a-1635-4283-9318-131480fd2f23', 'dfbe963a-9737-414d-bc53-49e2a202d1c1', 'e67c8bf1-e871-47d2-948a-ebce1b90fe54'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:03 devstack sudo[101222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3
Nov 05 03:53:03 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:03 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:03 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:03 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:03 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 1G
Nov 05 03:53:03 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:03 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Deleted volume successfully.
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bc984a35-a5df-4214-8715-830ff30254e9 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "cinder-5d288531-fa5f-4484-ad5e-c4bb798b933f-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:04 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 1G" returned: 0 in 0.681s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453fe161-9e00-4796-bc4c-c962629708e3 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:04 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453fe161-9e00-4796-bc4c-c962629708e3 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526
Nov 05 03:53:04 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:04 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453fe161-9e00-4796-bc4c-c962629708e3 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:04 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 is being set with open permissions: ugo+rw
Nov 05 03:53:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:04 devstack sudo[101250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526
Nov 05 03:53:04 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:05 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526" returned: 0 in 0.633s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Flow 'volume_create_manager' (ec711f8e-6c2b-44e9-8104-9997d6dfe8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb16a965-ca14-4def-b211-0b4474544c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb16a965-ca14-4def-b211-0b4474544c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-169634226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d618d6f-6113-44f3-9ce4-ad0f7e9b0277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a25073982c4466c92ef2576a5830357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:05Z,use_quota=True,user_id='c059e8a0e2b8452f87c961d4f13822ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccce4de-b060-4563-958b-df5bc28fad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccce4de-b060-4563-958b-df5bc28fad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7be50b-835a-4d2c-bbff-ed1528dd5941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7be50b-835a-4d2c-bbff-ed1528dd5941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d618d6f-6113-44f3-9ce4-ad0f7e9b0277', 'volume_name': 'volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c703f20-491f-467f-a110-f5391e440497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c703f20-491f-467f-a110-f5391e440497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c128ce-d26b-4c8f-9eb0-5e9bcd9cb70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Volume 0d618d6f-6113-44f3-9ce4-ad0f7e9b0277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277', 'volume_size': 1}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:05 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info
Nov 05 03:53:05 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-225ed31f-00c0-4c50-bf93-f963bf310bef req-7777db84-c5a5-4392-9089-3a84ca8a0b4e tempest-TestShelveInstance-439626377 None] Terminate volume connection completed successfully.
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-225ed31f-00c0-4c50-bf93-f963bf310bef req-7777db84-c5a5-4392-9089-3a84ca8a0b4e tempest-TestShelveInstance-439626377 None] Deleting attachment 58cdabbe-1c7c-4222-bcc5-a27fff049779. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:53:05 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info" returned: 0 in 0.277s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:05 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info is being set with open permissions: ugo+rw
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:05 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info
Nov 05 03:53:05 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:05 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.info" returned: 0 in 0.265s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.051s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Creating offline snapshot 3fd7503f-5676-4f1a-a908-5a7eb8be5501 of volume 58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5018c94c-d240-44fd-a971-ace99c0e66bb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ba5d3ec1-a316-4e1f-89fa-0c3ba2e99aa9 tempest-VolumesSnapshotTestJSON-1720905235 None] Create snapshot completed successfully
Nov 05 03:53:06 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0
Nov 05 03:53:06 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:06 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0" returned: 0 in 0.389s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:06 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 1G
Nov 05 03:53:06 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (8865af94-c56a-472d-ab0d-5190ab74e080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bc2ae9-2d0b-4c27-a445-ce565e4f7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bc2ae9-2d0b-4c27-a445-ce565e4f7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-696107237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cc47cdc8-a3da-49f4-8906-a84f353ff526,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:07Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92275db0-52af-4174-b71f-a03038868f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92275db0-52af-4174-b71f-a03038868f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a2cbf1-aca8-4ed6-8d7a-c3153c959c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a2cbf1-aca8-4ed6-8d7a-c3153c959c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a', 'volume_name': 'volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a', 'volume_size': 2, 'snapshot_id': 'cc47cdc8-a3da-49f4-8906-a84f353ff526'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9fcc00-c200-48a3-9680-c1aa95a670d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9fcc00-c200-48a3-9680-c1aa95a670d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cb210d-6d1b-4ebe-bd28-a2df44d4843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume 0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a', 'volume_size': 2, 'snapshot_id': 'cc47cdc8-a3da-49f4-8906-a84f353ff526'}
Nov 05 03:53:06 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 1G" returned: 0 in 0.564s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:06 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501
Nov 05 03:53:06 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:07 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 is being set with open permissions: ugo+rw
Nov 05 03:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:07 devstack sudo[101295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501
Nov 05 03:53:07 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:07 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:07 devstack sudo[101300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info
Nov 05 03:53:07 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:07 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info" returned: 0 in 0.279s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:07 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info is being set with open permissions: ugo+rw
Nov 05 03:53:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:07 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info
Nov 05 03:53:07 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:08 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.info" returned: 0 in 0.283s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.867s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-169634226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d618d6f-6113-44f3-9ce4-ad0f7e9b0277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a25073982c4466c92ef2576a5830357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:05Z,use_quota=True,user_id='c059e8a0e2b8452f87c961d4f13822ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Creating volume 0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:08 devstack sudo[101307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 1073741824
Nov 05 03:53:08 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-32c7fe71-d9b2-4a54-a44b-6228b4b12dc9 tempest-VolumesDeleteCascade-974177236 None] Create snapshot completed successfully
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-46c48623-4fdd-4008-a0b9-8bc5b992a2a2 req-99cd9c1f-ffb8-469f-bae7-706980f160da tempest-TestShelveInstance-439626377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:08 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 1073741824" returned: 0 in 0.526s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:08 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:08 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:08 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277
Nov 05 03:53:08 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:08 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.267s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:53:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:53:09 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277" returned: 0 in 0.250s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.129s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-cc47cdc8-a3da-49f4-8906-a84f353ff526-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c128ce-d26b-4c8f-9eb0-5e9bcd9cb70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44db358-8885-4e7c-ae53-0fa30687141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-cc47cdc8-a3da-49f4-8906-a84f353ff526-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating volume 0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a from snapshot cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Volume volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 (0d618d6f-6113-44f3-9ce4-ad0f7e9b0277): created successfully
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44db358-8885-4e7c-ae53-0fa30687141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Flow 'volume_create_manager' (ec711f8e-6c2b-44e9-8104-9997d6dfe8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] snapshot: cc47cdc8-a3da-49f4-8906-a84f353ff526, volume: 0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:53:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-416980b1-3f68-4b58-9399-23d16c451b89 tempest-VolumeQuotasAdminTestJSON-119880458 None] Created volume successfully.
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e28d36-1048-4804-8e4a-05fc36303e42]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:09 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526
Nov 05 03:53:09 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:09 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-453fe161-9e00-4796-bc4c-c962629708e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[49463bfd-fd33-4a96-ac8a-4429ea94d3e4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:09 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3
Nov 05 03:53:09 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Flow 'volume_create_manager' (a81b08c4-5d88-410a-adce-cc56043a3ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a26a5d5-106a-4ab7-b46b-f9ab288607b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a26a5d5-106a-4ab7-b46b-f9ab288607b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-482334379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f62a360-24f2-4e20-907d-920cb0e0f4b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d91af4a5b4a4ef3b0e464422a420344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fd7503f-5676-4f1a-a908-5a7eb8be5501,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:10Z,use_quota=True,user_id='722363829aaf4dcb96e015d34be8756e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507b5bb6-7f14-47c0-abc9-f9d9a8936c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507b5bb6-7f14-47c0-abc9-f9d9a8936c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022b1964-4471-4672-a0f0-1631bd458666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022b1964-4471-4672-a0f0-1631bd458666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f62a360-24f2-4e20-907d-920cb0e0f4b6', 'volume_name': 'volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6', 'volume_size': 1, 'snapshot_id': '3fd7503f-5676-4f1a-a908-5a7eb8be5501'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb15068-85d7-4edd-830e-2988337d15ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb15068-85d7-4edd-830e-2988337d15ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc81229-6f88-4b4d-9861-478b4c23f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Volume 2f62a360-24f2-4e20-907d-920cb0e0f4b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6', 'volume_size': 1, 'snapshot_id': '3fd7503f-5676-4f1a-a908-5a7eb8be5501'}
Nov 05 03:53:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:10 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:53:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:53:10 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:53:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:10 devstack sudo[101338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a
Nov 05 03:53:10 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ff8f837c-1173-45bd-9ee6-d2c08e579e2c tempest-VolumeQuotasAdminTestJSON-466522511 None] Transfer volume completed successfully.
Nov 05 03:53:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Acquiring lock "cinder-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Lock "cinder-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Acquiring lock "cinder-quobyte-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Lock "cinder-quobyte-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[790892bc-89ba-4476-bba8-d6d004446032]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:11 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277
Nov 05 03:53:11 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:12 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277" returned: 0 in 0.577s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:12 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277
Nov 05 03:53:12 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:12 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Lock "cinder-quobyte-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277" released by "delete_volume" :: held 1.174s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:12 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Created reservations ['b0412b27-0a50-408c-8c27-1acd1aa49d08', '82ffdb14-899f-4290-a935-d3ba9a1cd555', '75604854-cc60-459d-90d7-e032a6d0a420', '414ff990-b052-44e9-ab8d-2a273e6d74c8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:13 devstack sudo[101361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:13 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:13 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.432s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Deleted volume successfully.
Nov 05 03:53:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c361a460-f8d8-4a0b-98a3-553cd49f0473 tempest-VolumeQuotasAdminTestJSON-213897164 None] Lock "cinder-0d618d6f-6113-44f3-9ce4-ad0f7e9b0277-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:17 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" returned: 0 in 7.491s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:17 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:53:17 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Converted 1024.00 MB image at 136.67 MB/s
Nov 05 03:53:17 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a is being set with open permissions: ugo+rw
Nov 05 03:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:17 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a
Nov 05 03:53:17 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:17 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" released by "_copy_volume_from_snapshot" :: held 8.853s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-cc47cdc8-a3da-49f4-8906-a84f353ff526-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" released by "_create_volume_from_snapshot" :: held 8.950s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.986s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-46c48623-4fdd-4008-a0b9-8bc5b992a2a2 req-99cd9c1f-ffb8-469f-bae7-706980f160da tempest-TestShelveInstance-439626377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.512s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-46c48623-4fdd-4008-a0b9-8bc5b992a2a2 req-99cd9c1f-ffb8-469f-bae7-706980f160da tempest-TestShelveInstance-439626377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.127s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-3fd7503f-5676-4f1a-a908-5a7eb8be5501-2f62a360-24f2-4e20-907d-920cb0e0f4b6" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cb210d-6d1b-4ebe-bd28-a2df44d4843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a', 'volume_size': 2, 'snapshot_id': 'cc47cdc8-a3da-49f4-8906-a84f353ff526'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6cd1b3-c505-4bd0-805d-1b4fd484d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-3fd7503f-5676-4f1a-a908-5a7eb8be5501-2f62a360-24f2-4e20-907d-920cb0e0f4b6" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Creating volume 2f62a360-24f2-4e20-907d-920cb0e0f4b6 from snapshot 3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-2f62a360-24f2-4e20-907d-920cb0e0f4b6" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a (0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a): created successfully
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6cd1b3-c505-4bd0-805d-1b4fd484d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (8865af94-c56a-472d-ab0d-5190ab74e080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-2f62a360-24f2-4e20-907d-920cb0e0f4b6" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] snapshot: 3fd7503f-5676-4f1a-a908-5a7eb8be5501, volume: 2f62a360-24f2-4e20-907d-920cb0e0f4b6,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-46c48623-4fdd-4008-a0b9-8bc5b992a2a2 req-99cd9c1f-ffb8-469f-bae7-706980f160da tempest-TestShelveInstance-439626377 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e35dac1f-008e-4e92-b5b9-a594e221b21f', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fb89f94c-165e-4279-8825-69540386e4b5 tempest-VolumesSnapshotTestJSON-1720905235 None] Created volume successfully.
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc06ac3e-7ec3-4a1e-bb97-5dc170d24c25]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-46c48623-4fdd-4008-a0b9-8bc5b992a2a2 req-99cd9c1f-ffb8-469f-bae7-706980f160da tempest-TestShelveInstance-439626377 None] attachment_update completed successfully.
Nov 05 03:53:18 devstack sudo[101369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501
Nov 05 03:53:18 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:18 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501" returned: 0 in 0.588s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f5d807-83df-48e9-9966-773f88f0aa0f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:18 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0
Nov 05 03:53:18 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:19 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0" returned: 0 in 0.606s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:19 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6
Nov 05 03:53:19 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1141f4-4d21-43d1-ac75-1c520b51595d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:19 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a
Nov 05 03:53:19 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:20 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" returned: 0 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:20 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a
Nov 05 03:53:20 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:20 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a" released by "delete_volume" :: held 1.201s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['c7050fc7-dbb0-456a-a549-5431f0852b3f', 'e2d97c2b-96d7-43b3-8b68-bef70f513387', '11c8bd49-fa39-4e16-a9c7-2cadf6e867a8', '91fc7a46-8f05-4cce-8447-cf0aed4790db'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:21 devstack sudo[101399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:21 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:21 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Deleted volume successfully.
Nov 05 03:53:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bd1bd50a-5bbf-4e30-9327-731426c19e81 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-0fb66d06-df1d-4fb9-b9cb-b0c55aa60a0a-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-cc47cdc8-a3da-49f4-8906-a84f353ff526-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-cc47cdc8-a3da-49f4-8906-a84f353ff526-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-453fe161-9e00-4796-bc4c-c962629708e3" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-453fe161-9e00-4796-bc4c-c962629708e3" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-cc47cdc8-a3da-49f4-8906-a84f353ff526" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-cc47cdc8-a3da-49f4-8906-a84f353ff526" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Deleting offline snapshot cc47cdc8-a3da-49f4-8906-a84f353ff526 of volume 453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] snapshot_file for this snap is: volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[50717056-b4b8-421d-9215-ada91293562d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:22 devstack sudo[101404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526
Nov 05 03:53:22 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:23 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526" returned: 0 in 0.885s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-453fe161-9e00-4796-bc4c-c962629708e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b7401-dcc6-4370-bbfb-df98f4ed1c5e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:23 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3
Nov 05 03:53:23 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:24 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3" returned: 0 in 1.141s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:24 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526
Nov 05 03:53:24 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:25 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526" returned: 0 in 1.228s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:25 devstack sudo[101533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526
Nov 05 03:53:25 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:26 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3.cc47cdc8-a3da-49f4-8906-a84f353ff526" returned: 0 in 0.829s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-cc47cdc8-a3da-49f4-8906-a84f353ff526" released by "_delete_snapshot" :: held 4.522s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-453fe161-9e00-4796-bc4c-c962629708e3" released by "delete_snapshot" :: held 4.638s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:26 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['9b393752-f432-41f3-9b86-c7f9590bfbd6', '3ced4a57-cf6f-4127-a6ca-078a21a85175', '2bf936c7-7990-45bf-b766-c3a3bcbaf1cb', '360f9dda-1f43-46fe-9d52-a5101fe4572a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Delete snapshot completed successfully.
Nov 05 03:53:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2f2fac55-844d-4da5-8a63-107f86249bbc tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-cc47cdc8-a3da-49f4-8906-a84f353ff526-delete_snapshot" released by "delete_snapshot" :: held 5.197s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-453fe161-9e00-4796-bc4c-c962629708e3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-453fe161-9e00-4796-bc4c-c962629708e3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-453fe161-9e00-4796-bc4c-c962629708e3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-453fe161-9e00-4796-bc4c-c962629708e3" acquired by "delete_volume" :: waited 0.061s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5667e8f2-9bf3-440a-8b5a-526a817b75f1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:28 devstack sudo[101904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3
Nov 05 03:53:28 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:29 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3" returned: 0 in 1.253s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:30 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3
Nov 05 03:53:30 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:31 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-453fe161-9e00-4796-bc4c-c962629708e3" returned: 0 in 1.036s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-453fe161-9e00-4796-bc4c-c962629708e3" released by "delete_volume" :: held 2.560s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['16224565-0393-4e04-9052-3075e1998dc7', '8d683d86-4f40-4235-9888-01733574ccdd', '6020c343-fed7-4fea-b64f-ca54a7dfa645', 'f5dce8ac-a00d-4b14-aecc-7918c965a59c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:31 devstack sudo[101915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:31 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:32 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6" returned: 0 in 12.631s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0, size 1024.00 MB, duration 12.64 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:53:32 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Converted 1024.00 MB image at 81.04 MB/s
Nov 05 03:53:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 is being set with open permissions: ugo+rw
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:32 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6
Nov 05 03:53:32 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:32 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.813s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Deleted volume successfully.
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-17e6d8fd-080d-40eb-8ed5-8978ec0950f8 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-453fe161-9e00-4796-bc4c-c962629708e3-delete_volume" released by "delete_volume" :: held 4.276s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:32 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6" returned: 0 in 0.555s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-2f62a360-24f2-4e20-907d-920cb0e0f4b6" released by "_copy_volume_from_snapshot" :: held 14.502s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-3fd7503f-5676-4f1a-a908-5a7eb8be5501-2f62a360-24f2-4e20-907d-920cb0e0f4b6" released by "_create_volume_from_snapshot" :: held 14.670s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.708s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc81229-6f88-4b4d-9861-478b4c23f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6', 'volume_size': 1, 'snapshot_id': '3fd7503f-5676-4f1a-a908-5a7eb8be5501'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cd7553-fe04-4951-9df8-58809db5ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Volume volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 (2f62a360-24f2-4e20-907d-920cb0e0f4b6): created successfully
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cd7553-fe04-4951-9df8-58809db5ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Flow 'volume_create_manager' (a81b08c4-5d88-410a-adce-cc56043a3ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4c24db86-692a-4222-ace5-eb349d368463 tempest-VolumesDeleteCascade-974177236 None] Created volume successfully.
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (afc306af-3eac-49f3-906a-a0f1e8283a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c3bc8a-54af-4c46-b683-4acaa7939315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c3bc8a-54af-4c46-b683-4acaa7939315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1057416251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd4611d-0587-4701-af18-f319828e5653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:33Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344ba4e8-9bcd-4e70-bdf1-cc11a62238b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344ba4e8-9bcd-4e70-bdf1-cc11a62238b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d85228b-9354-4f6e-b214-fbac9bc80cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d85228b-9354-4f6e-b214-fbac9bc80cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd4611d-0587-4701-af18-f319828e5653', 'volume_name': 'volume-1bd4611d-0587-4701-af18-f319828e5653', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f2cfaa-b9ad-4acb-8523-46b2a596b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f2cfaa-b9ad-4acb-8523-46b2a596b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cfb362-c4bb-4c99-99e0-707f3d053aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Volume 1bd4611d-0587-4701-af18-f319828e5653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd4611d-0587-4701-af18-f319828e5653', 'volume_size': 1}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1057416251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd4611d-0587-4701-af18-f319828e5653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:33Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Creating volume 1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:33 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 1073741824
Nov 05 03:53:33 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-58bc3393-b51d-4446-ab06-2ea4b667c9d0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-58bc3393-b51d-4446-ab06-2ea4b667c9d0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Performing cascade delete. {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-3fd7503f-5676-4f1a-a908-5a7eb8be5501-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-3fd7503f-5676-4f1a-a908-5a7eb8be5501-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-58bc3393-b51d-4446-ab06-2ea4b667c9d0" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:33 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-58bc3393-b51d-4446-ab06-2ea4b667c9d0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-3fd7503f-5676-4f1a-a908-5a7eb8be5501" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 1073741824" returned: 0 in 0.778s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-3fd7503f-5676-4f1a-a908-5a7eb8be5501" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Deleting offline snapshot 3fd7503f-5676-4f1a-a908-5a7eb8be5501 of volume 58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] snapshot_file for this snap is: volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e0de6-b203-480f-a5f3-b4c997e47f96]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Flow 'volume_create_manager' (81fb16b7-0c27-42aa-ae9c-1e38a5795115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:34 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653
Nov 05 03:53:34 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcff4a16-0ad9-438e-875c-e9642491f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcff4a16-0ad9-438e-875c-e9642491f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-893502871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55e0268-2014-45ba-bad0-5e76bb4e041a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4830cd5413be44209a0292f27a78da49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:34Z,use_quota=True,user_id='1faa3935585040c5bff2e4d94e5ae064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7abea5d-bdf7-47ba-8588-0c11bf12e292),volume_type_id=b7abea5d-bdf7-47ba-8588-0c11bf12e292)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41970f3c-2c36-4fc8-b125-3f4a1b2005b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41970f3c-2c36-4fc8-b125-3f4a1b2005b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bab9c1-e7ec-428e-8e82-584217108807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bab9c1-e7ec-428e-8e82-584217108807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55e0268-2014-45ba-bad0-5e76bb4e041a', 'volume_name': 'volume-a55e0268-2014-45ba-bad0-5e76bb4e041a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfd3264-ea2c-4e43-b1fd-cda8f4634bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:34 devstack sudo[101927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501
Nov 05 03:53:34 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfd3264-ea2c-4e43-b1fd-cda8f4634bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e061e718-8d36-4d63-b169-5b74256a14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Volume a55e0268-2014-45ba-bad0-5e76bb4e041a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55e0268-2014-45ba-bad0-5e76bb4e041a', 'volume_size': 1}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:34 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653" returned: 0 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-893502871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55e0268-2014-45ba-bad0-5e76bb4e041a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4830cd5413be44209a0292f27a78da49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:34Z,use_quota=True,user_id='1faa3935585040c5bff2e4d94e5ae064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7abea5d-bdf7-47ba-8588-0c11bf12e292),volume_type_id=b7abea5d-bdf7-47ba-8588-0c11bf12e292)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Creating volume a55e0268-2014-45ba-bad0-5e76bb4e041a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:34 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cfb362-c4bb-4c99-99e0-707f3d053aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd4611d-0587-4701-af18-f319828e5653', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac36a80-90ef-450a-99f8-19ce52126f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:34 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a 1073741824
Nov 05 03:53:34 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501" returned: 0 in 0.489s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Volume volume-1bd4611d-0587-4701-af18-f319828e5653 (1bd4611d-0587-4701-af18-f319828e5653): created successfully
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac36a80-90ef-450a-99f8-19ce52126f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (afc306af-3eac-49f3-906a-a0f1e8283a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a783dc49-943a-4d73-a518-ab51573fbaab]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8f31dfe2-595c-4b8f-a2e4-aed10301ec8c tempest-VolumesSnapshotTestJSON-1720905235 None] Created volume successfully.
Nov 05 03:53:34 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0
Nov 05 03:53:34 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:35 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a 1073741824" returned: 0 in 0.652s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:35 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a
Nov 05 03:53:35 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:35 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0" returned: 0 in 0.819s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:35 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501
Nov 05 03:53:35 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:35 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.190s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Creating offline snapshot dae1431c-ee40-40d8-a870-eb971f19b2ae of volume 1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e061e718-8d36-4d63-b169-5b74256a14ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55e0268-2014-45ba-bad0-5e76bb4e041a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80203cf-2e21-4014-8cc7-76f955dac3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[79103bb9-5d7e-4b0b-8334-cc74fb4db060]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Volume volume-a55e0268-2014-45ba-bad0-5e76bb4e041a (a55e0268-2014-45ba-bad0-5e76bb4e041a): created successfully
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80203cf-2e21-4014-8cc7-76f955dac3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Flow 'volume_create_manager' (81fb16b7-0c27-42aa-ae9c-1e38a5795115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-adec5eb1-98ed-4788-85d6-37ac51ce86b8 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Created volume successfully.
Nov 05 03:53:35 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:35 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653
Nov 05 03:53:35 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:35 devstack sudo[101956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501
Nov 05 03:53:35 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:36 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0.3fd7503f-5676-4f1a-a908-5a7eb8be5501" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:36 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653" returned: 0 in 0.629s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-3fd7503f-5676-4f1a-a908-5a7eb8be5501" released by "_delete_snapshot" :: held 2.399s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-58bc3393-b51d-4446-ab06-2ea4b667c9d0" released by "delete_snapshot" :: held 2.461s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:36 devstack sudo[101964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae 1G
Nov 05 03:53:36 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Created reservations ['b8f86da9-d508-4f62-aeb0-22c380f7b32c', 'f335204a-a4d7-4e70-a828-5b180eceab6a', '3dc4bd85-79eb-4260-be87-61fde4b336c3', '109d6c96-3c2d-4764-91da-30ea09f39f62'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Delete snapshot completed successfully.
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-3fd7503f-5676-4f1a-a908-5a7eb8be5501-delete_snapshot" released by "delete_snapshot" :: held 2.875s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Snapshots deleted, issuing volume delete {{(pid=87098) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-58bc3393-b51d-4446-ab06-2ea4b667c9d0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-58bc3393-b51d-4446-ab06-2ea4b667c9d0" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[97999ac7-1e88-4149-96c6-b8f6858f375e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:36 devstack sudo[101970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:36 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:36 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0
Nov 05 03:53:36 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:36 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae 1G" returned: 0 in 0.673s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd4611d-0587-4701-af18-f319828e5653 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:37 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd4611d-0587-4701-af18-f319828e5653 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae
Nov 05 03:53:37 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:37 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:37 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:37 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0
Nov 05 03:53:37 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fd473e41-2719-4915-abd4-cdf95a517134 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Retype volume completed successfully.
Nov 05 03:53:37 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd4611d-0587-4701-af18-f319828e5653 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae is being set with open permissions: ugo+rw
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:37 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae
Nov 05 03:53:37 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:37 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58bc3393-b51d-4446-ab06-2ea4b667c9d0" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-58bc3393-b51d-4446-ab06-2ea4b667c9d0" released by "delete_volume" :: held 0.845s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Created reservations ['3149497f-1de0-44d1-9a3e-2a2f380bbfcb', '01888f3a-e07d-4091-aa25-7e13b3dcf71d', '211b5edc-bd90-465d-bd44-4642c06c3749', '285e1cee-7e66-43a9-8582-d4ba72985782'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:37 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:37 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info
Nov 05 03:53:37 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:37 devstack sudo[101992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:37 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:38 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Acquiring lock "cinder-a55e0268-2014-45ba-bad0-5e76bb4e041a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info" returned: 0 in 0.406s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info is being set with open permissions: ugo+rw
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:38 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.403s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "cinder-a55e0268-2014-45ba-bad0-5e76bb4e041a-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Deleted volume successfully.
Nov 05 03:53:38 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info
Nov 05 03:53:38 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e71ef1eb-9c49-438b-b260-c11d10afac21 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-58bc3393-b51d-4446-ab06-2ea4b667c9d0-delete_volume" released by "delete_volume" :: held 4.641s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Acquiring lock "cinder-quobyte-a55e0268-2014-45ba-bad0-5e76bb4e041a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "cinder-quobyte-a55e0268-2014-45ba-bad0-5e76bb4e041a" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa4c439-989d-436d-9d1b-4acbad058f77]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-2f62a360-24f2-4e20-907d-920cb0e0f4b6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-2f62a360-24f2-4e20-907d-920cb0e0f4b6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:38 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a
Nov 05 03:53:38 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "cinder-quobyte-2f62a360-24f2-4e20-907d-920cb0e0f4b6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:38 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.info" returned: 0 in 0.505s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-2f62a360-24f2-4e20-907d-920cb0e0f4b6" acquired by "delete_volume" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae37733-c519-411c-bdf4-97e9678053dd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e40c6d93-71d6-4772-9789-e35963d81d7e tempest-VolumesSnapshotTestJSON-1720905235 None] Create snapshot completed successfully
Nov 05 03:53:38 devstack sudo[102001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6
Nov 05 03:53:38 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:38 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a" returned: 0 in 0.542s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:38 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a
Nov 05 03:53:38 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:39 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:39 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6
Nov 05 03:53:39 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:39 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a55e0268-2014-45ba-bad0-5e76bb4e041a" returned: 0 in 0.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "cinder-quobyte-a55e0268-2014-45ba-bad0-5e76bb4e041a" released by "delete_volume" :: held 0.891s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:39 devstack cinder-volume[87098]: WARNING cinder.quota [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:53:39 devstack cinder-volume[87098]: WARNING cinder.quota [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Created reservations ['53fa08e6-3424-44ff-bd2c-c09fb85a50b5', 'db70d49e-eafa-4fe3-835c-14e3d14a6774', '95e1dab5-93a4-4da2-917d-15ac7e6f126c', '60a820f1-06a6-4f22-9e4e-96a537cd92c8'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:39 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-2f62a360-24f2-4e20-907d-920cb0e0f4b6" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-quobyte-2f62a360-24f2-4e20-907d-920cb0e0f4b6" released by "delete_volume" :: held 0.802s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:39 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:39 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Created reservations ['2225af5b-6064-4c3e-9007-1d35e9c6fae3', 'ad35f150-154a-4084-8eea-94ef6e72e7e5', '86abf38c-c68d-498b-ae85-8c341512ba01', '59f63151-439b-486d-a1c8-f4660cbfdc87'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:39 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:39 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:39 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Deleted volume successfully.
Nov 05 03:53:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35d9820e-ce4a-4413-ad06-f0f9aa693387 tempest-VolumeRetypeWithoutMigrationTest-1148031053 None] Lock "cinder-a55e0268-2014-45ba-bad0-5e76bb4e041a-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:40 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Deleted volume successfully.
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c936d1bb-85a3-439d-8567-b1b460483509 tempest-VolumesDeleteCascade-974177236 None] Lock "cinder-2f62a360-24f2-4e20-907d-920cb0e0f4b6-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (a0f43ceb-be41-4aa4-9098-536d79e64fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a2f9c0-3bb7-42e7-a3a1-93431fcf0289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a2f9c0-3bb7-42e7-a3a1-93431fcf0289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-895406363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecaeb01a-1c32-4967-ac11-1c17a3a4a50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f794ca25bcdc42bb9e3aa37233bf03f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dae1431c-ee40-40d8-a870-eb971f19b2ae,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:41Z,use_quota=True,user_id='9d68391efdf84798a506efca3abfa6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a824d2-ff6d-4aa1-bff3-998d274383ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a824d2-ff6d-4aa1-bff3-998d274383ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39f0e47-3a47-407f-973d-b739558e5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39f0e47-3a47-407f-973d-b739558e5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecaeb01a-1c32-4967-ac11-1c17a3a4a50c', 'volume_name': 'volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c', 'volume_size': 1, 'snapshot_id': 'dae1431c-ee40-40d8-a870-eb971f19b2ae'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3898ba5c-2b3f-4e0c-b22d-c395674d73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3898ba5c-2b3f-4e0c-b22d-c395674d73d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c313add-66bc-4eaa-8a09-0da3e3bfb273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume ecaeb01a-1c32-4967-ac11-1c17a3a4a50c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c', 'volume_size': 1, 'snapshot_id': 'dae1431c-ee40-40d8-a870-eb971f19b2ae'}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-dae1431c-ee40-40d8-a870-eb971f19b2ae-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-dae1431c-ee40-40d8-a870-eb971f19b2ae-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating volume ecaeb01a-1c32-4967-ac11-1c17a3a4a50c from snapshot dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] snapshot: dae1431c-ee40-40d8-a870-eb971f19b2ae, volume: ecaeb01a-1c32-4967-ac11-1c17a3a4a50c,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a396c-5f47-4d72-a50a-cb4a8dba8e69]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:41 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae
Nov 05 03:53:41 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:41 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae" returned: 0 in 0.602s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd4611d-0587-4701-af18-f319828e5653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747dbed-7c77-4b0e-930f-da4e3b43d15c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:41 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653
Nov 05 03:53:41 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:42 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653" returned: 0 in 0.575s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:53:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:53:42 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:53:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:42 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c
Nov 05 03:53:42 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:DELETE=10,cinder:SELECT=144,cinder:INSERT=32,cinder:UPDATE=138 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:53:51 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=134,cinder:INSERT=37,cinder:UPDATE=142,cinder:DELETE=14 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:53:52 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" returned: 0 in 9.858s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653, size 1024.00 MB, duration 9.86 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:53:52 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Converted 1024.00 MB image at 103.87 MB/s
Nov 05 03:53:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c is being set with open permissions: ugo+rw
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:52 devstack sudo[102082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c
Nov 05 03:53:52 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:52 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" returned: 0 in 0.350s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" released by "_copy_volume_from_snapshot" :: held 11.523s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-dae1431c-ee40-40d8-a870-eb971f19b2ae-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" released by "_create_volume_from_snapshot" :: held 11.637s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.664s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c313add-66bc-4eaa-8a09-0da3e3bfb273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c', 'volume_size': 1, 'snapshot_id': 'dae1431c-ee40-40d8-a870-eb971f19b2ae'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eec690-332a-455c-afcf-022420b9ffe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Volume volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c (ecaeb01a-1c32-4967-ac11-1c17a3a4a50c): created successfully
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eec690-332a-455c-afcf-022420b9ffe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Flow 'volume_create_manager' (a0f43ceb-be41-4aa4-9098-536d79e64fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0957c759-fa50-4441-819c-3a3cb24a7915 tempest-VolumesSnapshotTestJSON-1720905235 None] Created volume successfully.
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Flow 'volume_create_manager' (2a6faf14-f3eb-43ea-8559-6087dd59678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8ea8fc-6c34-403e-af30-e88c4ef4f75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8ea8fc-6c34-403e-af30-e88c4ef4f75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-29735103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa3771c-acb1-43fb-8e48-f70b3697d488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eaf370758345bca26585636c153ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:53Z,use_quota=True,user_id='d3e04dfb68ea4fd6882bf312541bf48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d30ff41-0ceb-48ea-9ed5-7a368fb766c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d30ff41-0ceb-48ea-9ed5-7a368fb766c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d90b42b-a9aa-4be0-8d0b-0a813aaec3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d90b42b-a9aa-4be0-8d0b-0a813aaec3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa3771c-acb1-43fb-8e48-f70b3697d488', 'volume_name': 'volume-9fa3771c-acb1-43fb-8e48-f70b3697d488', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b571c7db-c030-4c68-9d91-16c64af4f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b571c7db-c030-4c68-9d91-16c64af4f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e47f6b3-f92d-4b4b-8522-bdb3fd5c34d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Volume 9fa3771c-acb1-43fb-8e48-f70b3697d488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa3771c-acb1-43fb-8e48-f70b3697d488', 'volume_size': 1}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-29735103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa3771c-acb1-43fb-8e48-f70b3697d488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eaf370758345bca26585636c153ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:53Z,use_quota=True,user_id='d3e04dfb68ea4fd6882bf312541bf48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Creating volume 9fa3771c-acb1-43fb-8e48-f70b3697d488 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:52 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:52 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 1073741824
Nov 05 03:53:52 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:53 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 1073741824" returned: 0 in 0.502s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:53 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488
Nov 05 03:53:53 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:54 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488" returned: 0 in 0.538s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e47f6b3-f92d-4b4b-8522-bdb3fd5c34d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa3771c-acb1-43fb-8e48-f70b3697d488', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100910d6-8c71-4d14-8193-e2426e089e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda1f62-5698-4e4c-a5bb-a8aae3620958]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Volume volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 (9fa3771c-acb1-43fb-8e48-f70b3697d488): created successfully
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100910d6-8c71-4d14-8193-e2426e089e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Flow 'volume_create_manager' (2a6faf14-f3eb-43ea-8559-6087dd59678b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5206fa40-f473-4db8-98f6-76b88f578ce8 tempest-VolumesTransfersV357Test-297674188 None] Created volume successfully.
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Flow 'volume_create_manager' (8cdffa58-d19e-4b3a-ac9e-e9ef91bf3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e424b570-b537-4d9f-ae9d-2efbc7d229db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:54 devstack sudo[102094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c
Nov 05 03:53:54 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e424b570-b537-4d9f-ae9d-2efbc7d229db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1614699744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751ce4e2-627b-4322-af5e-1aa8336424ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47815e1badb4797885d1133289662ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:54Z,use_quota=True,user_id='0df526e03e2b46d6aa134bda856edfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1121770d-9445-429b-9fc3-387e9e57976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1121770d-9445-429b-9fc3-387e9e57976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb705021-2c09-4f14-96d1-1de2e38e28f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb705021-2c09-4f14-96d1-1de2e38e28f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751ce4e2-627b-4322-af5e-1aa8336424ce', 'volume_name': 'volume-751ce4e2-627b-4322-af5e-1aa8336424ce', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a70ee6-ee81-4556-8f05-3d73352bb1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a70ee6-ee81-4556-8f05-3d73352bb1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d778e767-6c1c-483b-a15f-8d0fa42d772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Volume 751ce4e2-627b-4322-af5e-1aa8336424ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751ce4e2-627b-4322-af5e-1aa8336424ce', 'volume_size': 1}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1614699744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751ce4e2-627b-4322-af5e-1aa8336424ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47815e1badb4797885d1133289662ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:54Z,use_quota=True,user_id='0df526e03e2b46d6aa134bda856edfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Creating volume 751ce4e2-627b-4322-af5e-1aa8336424ce {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:54 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:54 devstack sudo[102096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce 1073741824
Nov 05 03:53:54 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:54 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" returned: 0 in 0.564s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:54 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c
Nov 05 03:53:54 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:55 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce 1073741824" returned: 0 in 0.703s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:55 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c" released by "delete_volume" :: held 1.079s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:55 devstack sudo[102108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce
Nov 05 03:53:55 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['56a2bebc-0387-4013-a451-134b1f967a71', '0bb40038-22e0-4e7a-a9eb-406863342f53', 'cd728e36-c119-465b-bc0a-3b36331b3e26', '226017ca-b0e0-42f1-aeb6-9a1023af4868'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:55 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:55 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:55 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d778e767-6c1c-483b-a15f-8d0fa42d772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751ce4e2-627b-4322-af5e-1aa8336424ce', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7022a819-b693-4b82-8f08-c0cb65e117df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Volume volume-751ce4e2-627b-4322-af5e-1aa8336424ce (751ce4e2-627b-4322-af5e-1aa8336424ce): created successfully
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7022a819-b693-4b82-8f08-c0cb65e117df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Flow 'volume_create_manager' (8cdffa58-d19e-4b3a-ac9e-e9ef91bf3000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9a9df044-4e34-4487-91e6-3ecb384873e4 tempest-VolumesServicesTestJSON-347837552 None] Created volume successfully.
Nov 05 03:53:56 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.568s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Deleted volume successfully.
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6a3cc7d-a64a-4394-b04c-29d26ad8a01a tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-ecaeb01a-1c32-4967-ac11-1c17a3a4a50c-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-34882f5b-de8f-4131-85fb-4136fc50d1bb tempest-VolumesTransfersV357Test-726096458 None] Transfer volume completed successfully.
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-dae1431c-ee40-40d8-a870-eb971f19b2ae-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-dae1431c-ee40-40d8-a870-eb971f19b2ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-1bd4611d-0587-4701-af18-f319828e5653" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-1bd4611d-0587-4701-af18-f319828e5653" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-dae1431c-ee40-40d8-a870-eb971f19b2ae" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-dae1431c-ee40-40d8-a870-eb971f19b2ae" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Deleting offline snapshot dae1431c-ee40-40d8-a870-eb971f19b2ae of volume 1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] snapshot_file for this snap is: volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[da432fbd-83e8-4ccc-aec3-183e7c4f22f6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:56 devstack sudo[102150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae
Nov 05 03:53:56 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Acquiring lock "cinder-751ce4e2-627b-4322-af5e-1aa8336424ce-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Lock "cinder-751ce4e2-627b-4322-af5e-1aa8336424ce-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Acquiring lock "cinder-quobyte-751ce4e2-627b-4322-af5e-1aa8336424ce" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Lock "cinder-quobyte-751ce4e2-627b-4322-af5e-1aa8336424ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ec98a9-a5e4-4cc5-96c7-e56045065829]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:57 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae" returned: 0 in 0.523s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd4611d-0587-4701-af18-f319828e5653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:53:57 devstack sudo[102154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce
Nov 05 03:53:57 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36a667e-94a3-49dd-97e0-532a801f265e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Acquiring lock "cinder-9fa3771c-acb1-43fb-8e48-f70b3697d488-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-9fa3771c-acb1-43fb-8e48-f70b3697d488-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Acquiring lock "cinder-quobyte-9fa3771c-acb1-43fb-8e48-f70b3697d488" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-quobyte-9fa3771c-acb1-43fb-8e48-f70b3697d488" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:57 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653
Nov 05 03:53:57 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[439e0fa7-159f-42fc-9a71-bfa00feae417]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:57 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:57 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488
Nov 05 03:53:57 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:57 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce
Nov 05 03:53:57 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:57 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:57 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-751ce4e2-627b-4322-af5e-1aa8336424ce" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Lock "cinder-quobyte-751ce4e2-627b-4322-af5e-1aa8336424ce" released by "delete_volume" :: held 0.913s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:57 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488
Nov 05 03:53:57 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:57 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Created reservations ['024def1f-aedd-4445-b83c-92d43bffdaeb', 'd8931b7a-023b-451e-b1d0-5179f7bed486', 'beefd2bb-56ee-451b-b738-681d7087b49a', '6ca1ad69-182e-4a04-89aa-96ceafa72802'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653" returned: 0 in 0.790s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:57 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae
Nov 05 03:53:57 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:58 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:58 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:58 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-9fa3771c-acb1-43fb-8e48-f70b3697d488" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-quobyte-9fa3771c-acb1-43fb-8e48-f70b3697d488" released by "delete_volume" :: held 0.855s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Created reservations ['98cdde0a-3f3c-4679-b1a3-8d0167e90376', '46799a25-632b-450f-a97c-42887b4989f0', '19bfd484-1f11-4d4f-a400-e1f8fb04a086', '91ac14d7-7bc9-4a00-b427-8ddbd5ce2798'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:58 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:53:58 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:58 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Deleted volume successfully.
Nov 05 03:53:58 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae" returned: 0 in 0.534s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c34810c4-37e9-4624-becd-2701eef3eaed tempest-VolumesServicesTestJSON-347837552 None] Lock "cinder-751ce4e2-627b-4322-af5e-1aa8336424ce-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:58 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae
Nov 05 03:53:58 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:58 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:53:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Deleted volume successfully.
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a6603514-8b4d-425f-b80e-e6d7e3caf6ad tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-9fa3771c-acb1-43fb-8e48-f70b3697d488-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:58 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653.dae1431c-ee40-40d8-a870-eb971f19b2ae" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-dae1431c-ee40-40d8-a870-eb971f19b2ae" released by "_delete_snapshot" :: held 2.369s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-1bd4611d-0587-4701-af18-f319828e5653" released by "delete_snapshot" :: held 2.405s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['2dbf4fd1-98bd-4fb3-b986-968ff483267f', '64bb004d-cce6-4076-a797-252b43bdd9e4', '0d5bd2a1-497c-4a54-9d9d-865834f9a957', '6e62fbff-7155-4f3f-b4e5-93731861db7b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:53:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Delete snapshot completed successfully.
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5662388d-77a2-4a4b-b4bc-ab39bd81bafe tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-dae1431c-ee40-40d8-a870-eb971f19b2ae-delete_snapshot" released by "delete_snapshot" :: held 2.647s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Flow 'volume_create_manager' (37d14d37-8e2d-447f-84b0-1b44a8d008eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2e72c8-2751-4bfa-99a8-b728497cd432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2e72c8-2751-4bfa-99a8-b728497cd432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-755118196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a082b73c-ca95-48ab-bbf7-4f010a62d6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eaf370758345bca26585636c153ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:59Z,use_quota=True,user_id='d3e04dfb68ea4fd6882bf312541bf48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc16b81-2ce2-4ad8-a421-ed9630f75fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc16b81-2ce2-4ad8-a421-ed9630f75fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa05a03-f376-42e7-beac-0a274e51cf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa05a03-f376-42e7-beac-0a274e51cf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a082b73c-ca95-48ab-bbf7-4f010a62d6be', 'volume_name': 'volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca32fde6-f737-4aaf-ae85-f8ab8143488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca32fde6-f737-4aaf-ae85-f8ab8143488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce656f4-4ce4-4d89-b8d1-cd71f80a2857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:53:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Volume a082b73c-ca95-48ab-bbf7-4f010a62d6be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be', 'volume_size': 1}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-755118196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a082b73c-ca95-48ab-bbf7-4f010a62d6be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eaf370758345bca26585636c153ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:59Z,use_quota=True,user_id='d3e04dfb68ea4fd6882bf312541bf48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Creating volume a082b73c-ca95-48ab-bbf7-4f010a62d6be {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:53:59 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:59 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be 1073741824
Nov 05 03:53:59 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-1bd4611d-0587-4701-af18-f319828e5653-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-1bd4611d-0587-4701-af18-f319828e5653-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:59 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be 1073741824" returned: 0 in 0.638s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-1bd4611d-0587-4701-af18-f319828e5653" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:53:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-1bd4611d-0587-4701-af18-f319828e5653" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:53:59 devstack sudo[102196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be
Nov 05 03:53:59 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c577101a-96b1-4a51-8b29-cf3ccbbd4d26]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:00 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653
Nov 05 03:54:00 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:00 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce656f4-4ce4-4d89-b8d1-cd71f80a2857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21dea8a-1721-479f-87b7-9f439b01025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Volume volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be (a082b73c-ca95-48ab-bbf7-4f010a62d6be): created successfully
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21dea8a-1721-479f-87b7-9f439b01025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Flow 'volume_create_manager' (37d14d37-8e2d-447f-84b0-1b44a8d008eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a3af63fa-f64d-4132-a6fb-2c5762821717 tempest-VolumesTransfersV357Test-297674188 None] Created volume successfully.
Nov 05 03:54:00 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:00 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653
Nov 05 03:54:00 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:00 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1bd4611d-0587-4701-af18-f319828e5653" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-1bd4611d-0587-4701-af18-f319828e5653" released by "delete_volume" :: held 0.877s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['ddbb7da2-5619-4201-802c-63459b2b12f4', 'd29880a8-2f55-494f-a8ed-3aad66af7a69', 'ffc9edd1-4bb8-456b-a253-cc2482790436', 'aa6c8d8f-a273-43ea-8d04-bb273cbab0e2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:01 devstack sudo[102208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:01 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:01 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.331s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Deleted volume successfully.
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0e6c8f8a-e60a-4bbe-96b3-3aba21497768 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-1bd4611d-0587-4701-af18-f319828e5653-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Acquiring lock "cinder-a082b73c-ca95-48ab-bbf7-4f010a62d6be-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-a082b73c-ca95-48ab-bbf7-4f010a62d6be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Acquiring lock "cinder-quobyte-a082b73c-ca95-48ab-bbf7-4f010a62d6be" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-quobyte-a082b73c-ca95-48ab-bbf7-4f010a62d6be" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51af0e-84f2-48cd-b0a6-973d83ae73a4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:01 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be
Nov 05 03:54:01 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-834db3f5-548b-4d61-aeb8-2f8016d59993-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-834db3f5-548b-4d61-aeb8-2f8016d59993-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "cinder-quobyte-834db3f5-548b-4d61-aeb8-2f8016d59993" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-834db3f5-548b-4d61-aeb8-2f8016d59993" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:02 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be" returned: 0 in 0.547s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dca83b1-7292-4df0-875d-857c99c7c282]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:02 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be
Nov 05 03:54:02 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:02 devstack sudo[102217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993
Nov 05 03:54:02 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:02 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a082b73c-ca95-48ab-bbf7-4f010a62d6be" returned: 0 in 0.324s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-quobyte-a082b73c-ca95-48ab-bbf7-4f010a62d6be" released by "delete_volume" :: held 0.932s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Created reservations ['74c6b460-8905-4832-bc5e-7a3b3b1ea622', 'b45abb81-aee1-42f1-a0c1-ed31594c3590', 'fae04903-a1fe-43c5-a134-4911642aecdf', '3d2fdca0-e7da-49d8-ad39-7289482a3d08'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:02 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993" returned: 0 in 0.552s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:02 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:02 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:02 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993
Nov 05 03:54:02 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:03 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Deleted volume successfully.
Nov 05 03:54:03 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-834db3f5-548b-4d61-aeb8-2f8016d59993" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-quobyte-834db3f5-548b-4d61-aeb8-2f8016d59993" released by "delete_volume" :: held 0.967s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c54f5eed-1df1-4937-94db-dde7c92c4601 tempest-VolumesTransfersV357Test-1658873242 None] Lock "cinder-a082b73c-ca95-48ab-bbf7-4f010a62d6be-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Created reservations ['e79efcbe-730b-489b-a092-d303b794c43b', '03d30865-e962-4c48-b94f-aa2cc2b7a02c', 'ba6565d5-3a5a-4608-ad39-2f69e5f349b3', '4eb10c2e-df76-4d9a-9b6d-c97203c50469'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:03 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:03 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:03 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.302s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Deleted volume successfully.
Nov 05 03:54:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6c2c27d9-4acb-4e36-beac-8a97fd0603e3 tempest-VolumesSnapshotTestJSON-1720905235 None] Lock "cinder-834db3f5-548b-4d61-aeb8-2f8016d59993-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Flow 'volume_create_manager' (ac7676de-3b67-44ca-891f-2859560876b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013fa0b1-73c5-497a-a1ff-6888494c5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013fa0b1-73c5-497a-a1ff-6888494c5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1015141264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9b6729-b2f1-44e3-940f-102a04145fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c0e06684bb4b3c969d4d2060a011ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:08Z,use_quota=True,user_id='c57b44ddee4b442f93e8838388dac018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a553725-ff6d-4655-841f-7592d4d8f15a),volume_type_id=6a553725-ff6d-4655-841f-7592d4d8f15a)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4f5b8c-f2ee-43ee-9540-742dd17654e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4f5b8c-f2ee-43ee-9540-742dd17654e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55a47fc-5618-4008-ad7e-967bae8f3bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55a47fc-5618-4008-ad7e-967bae8f3bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9b6729-b2f1-44e3-940f-102a04145fce', 'volume_name': 'volume-de9b6729-b2f1-44e3-940f-102a04145fce', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89fd171-5925-43ff-92ba-c50ede87ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89fd171-5925-43ff-92ba-c50ede87ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc6e711-c51a-49c0-9776-ccf19fb47380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:07 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Volume de9b6729-b2f1-44e3-940f-102a04145fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9b6729-b2f1-44e3-940f-102a04145fce', 'volume_size': 1}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1015141264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9b6729-b2f1-44e3-940f-102a04145fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c0e06684bb4b3c969d4d2060a011ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:08Z,use_quota=True,user_id='c57b44ddee4b442f93e8838388dac018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a553725-ff6d-4655-841f-7592d4d8f15a),volume_type_id=6a553725-ff6d-4655-841f-7592d4d8f15a)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Creating volume de9b6729-b2f1-44e3-940f-102a04145fce {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:08 devstack sudo[102247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce 1073741824
Nov 05 03:54:08 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:08 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:08 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:08 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce 1073741824" returned: 0 in 0.794s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:08 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce
Nov 05 03:54:08 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:09 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:54:09 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce" returned: 0 in 0.480s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc6e711-c51a-49c0-9776-ccf19fb47380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9b6729-b2f1-44e3-940f-102a04145fce', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc46f48-ee80-4e72-a88d-12188b76899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Volume volume-de9b6729-b2f1-44e3-940f-102a04145fce (de9b6729-b2f1-44e3-940f-102a04145fce): created successfully
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc46f48-ee80-4e72-a88d-12188b76899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Flow 'volume_create_manager' (ac7676de-3b67-44ca-891f-2859560876b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7c82914a-e788-4d5a-b551-ea34a16741a0 tempest-VolumeTypesAccessTest-1466377458 None] Created volume successfully.
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Acquiring lock "cinder-de9b6729-b2f1-44e3-940f-102a04145fce-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Lock "cinder-de9b6729-b2f1-44e3-940f-102a04145fce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Acquiring lock "cinder-quobyte-de9b6729-b2f1-44e3-940f-102a04145fce" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Lock "cinder-quobyte-de9b6729-b2f1-44e3-940f-102a04145fce" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f209f9b-72e1-4755-a993-a8928da4db13]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:10 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce
Nov 05 03:54:10 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:10 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce" returned: 0 in 0.559s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:11 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce
Nov 05 03:54:11 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:11 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-de9b6729-b2f1-44e3-940f-102a04145fce" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Lock "cinder-quobyte-de9b6729-b2f1-44e3-940f-102a04145fce" released by "delete_volume" :: held 0.967s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:11 devstack cinder-volume[87098]: WARNING cinder.quota [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1552363003 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1552363003, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:54:11 devstack cinder-volume[87098]: WARNING cinder.quota [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1552363003 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1552363003, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Created reservations ['e9981de0-3e86-47fb-a93e-cc1527da05b6', '3f7d066d-4291-4317-a08b-62da3fc91f4d', 'f543c257-b4d2-41f0-908d-4be67588db57', '8fc5767f-088c-4278-af25-0d9e0c8cdaf2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:11 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:11 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-df7a67d6-a388-4800-900f-0ff401695720 req-d048512a-611a-463c-92d1-a5d5ee56d909 tempest-TestShelveInstance-439626377 None] Terminate volume connection completed successfully.
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-df7a67d6-a388-4800-900f-0ff401695720 req-d048512a-611a-463c-92d1-a5d5ee56d909 tempest-TestShelveInstance-439626377 None] Deleting attachment e35dac1f-008e-4e92-b5b9-a594e221b21f. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:54:11 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.362s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Deleted volume successfully.
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Acquiring lock "cinder-f3024d46-6e30-41cc-a522-5aed4d6ba71a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Lock "cinder-f3024d46-6e30-41cc-a522-5aed4d6ba71a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b8c6ea46-c2ec-47dc-8112-e591d5ab0494 tempest-VolumeTypesAccessTest-1466377458 None] Lock "cinder-de9b6729-b2f1-44e3-940f-102a04145fce-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Acquiring lock "cinder-quobyte-f3024d46-6e30-41cc-a522-5aed4d6ba71a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Lock "cinder-quobyte-f3024d46-6e30-41cc-a522-5aed4d6ba71a" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd34b1f5-f1f6-4b68-a7dd-b2fd08c45cf0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:12 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a
Nov 05 03:54:12 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:12 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a" returned: 0 in 0.631s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:12 devstack sudo[102303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a
Nov 05 03:54:12 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:13 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f3024d46-6e30-41cc-a522-5aed4d6ba71a" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Lock "cinder-quobyte-f3024d46-6e30-41cc-a522-5aed4d6ba71a" released by "delete_volume" :: held 1.147s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG cinder.quota [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Created reservations ['b96f4bf8-925a-4ec9-8b00-6240aef7be23', 'b9fc8feb-976d-4cd5-8e3d-55245665b547', '2f8f17f6-9a1b-4a61-a4ef-661cb16240e9', '25164513-f0a0-42ce-a7e4-9e9148a985cf'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:13 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:13 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:14 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.421s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:14 devstack cinder-volume[87098]: DEBUG cinder.manager [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Deleted volume successfully.
Nov 05 03:54:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [req-df7a67d6-a388-4800-900f-0ff401695720 req-176d9e1f-4893-41a6-bb96-ab54aea0085a tempest-TestShelveInstance-439626377 None] Lock "cinder-f3024d46-6e30-41cc-a522-5aed4d6ba71a-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (b820b65a-db6a-4a39-95c7-e90fdd67f195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a55eb4-0eb2-40b6-8b20-266281739b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a55eb4-0eb2-40b6-8b20-266281739b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2125994913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988987dd-2d3d-4369-a3c8-ef63b5b65f5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:19Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00321007-4e43-49b0-8570-fb2580c8be8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00321007-4e43-49b0-8570-fb2580c8be8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3395fcc6-2e84-49c0-8498-c9f975081384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3395fcc6-2e84-49c0-8498-c9f975081384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988987dd-2d3d-4369-a3c8-ef63b5b65f5a', 'volume_name': 'volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e191805-feec-45c5-8a56-f6855d496b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e191805-feec-45c5-8a56-f6855d496b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a949e9-d1e1-4db9-a116-7d3e6706e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Volume 988987dd-2d3d-4369-a3c8-ef63b5b65f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a', 'volume_size': 1}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2125994913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988987dd-2d3d-4369-a3c8-ef63b5b65f5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:19Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Creating volume 988987dd-2d3d-4369-a3c8-ef63b5b65f5a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Flow 'volume_create_manager' (8096c383-ea6e-4b96-b3ff-64cf33e9caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:19 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a 1073741824
Nov 05 03:54:19 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfcdf7b-f694-412e-9856-df7304b06907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfcdf7b-f694-412e-9856-df7304b06907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1383351264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a7c551-fdf3-4e07-ae5a-a4618471390f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2ed4db9e9149f2840de43f8883e443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:19Z,use_quota=True,user_id='ee9a5722b7074134aaeef4cc0d126bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16dc7e4-e873-426a-ba02-fb88f86f1afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16dc7e4-e873-426a-ba02-fb88f86f1afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c787e4-4e24-4e9f-acdb-dd1b89ec5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c787e4-4e24-4e9f-acdb-dd1b89ec5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a7c551-fdf3-4e07-ae5a-a4618471390f', 'volume_name': 'volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc929d3-655e-47a8-8330-52448cf453ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc929d3-655e-47a8-8330-52448cf453ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad145dc-9d8d-413d-b287-7ef32bada8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Volume d7a7c551-fdf3-4e07-ae5a-a4618471390f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f', 'volume_size': 2}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:19 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a 1073741824" returned: 0 in 0.646s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:19 devstack sudo[102318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a
Nov 05 03:54:19 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:20 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a" returned: 0 in 0.389s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1383351264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a7c551-fdf3-4e07-ae5a-a4618471390f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2ed4db9e9149f2840de43f8883e443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:19Z,use_quota=True,user_id='ee9a5722b7074134aaeef4cc0d126bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Creating volume d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:20 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f 2147483648 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a949e9-d1e1-4db9-a116-7d3e6706e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:20 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f 2147483648
Nov 05 03:54:20 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96a7557-8508-4995-a28a-2969c919c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Volume volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a (988987dd-2d3d-4369-a3c8-ef63b5b65f5a): created successfully
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96a7557-8508-4995-a28a-2969c919c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (b820b65a-db6a-4a39-95c7-e90fdd67f195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5c81ca86-012f-404d-9672-f2603d9a30a1 tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:54:21 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f 2147483648" returned: 0 in 0.801s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:21 devstack sudo[102327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f
Nov 05 03:54:21 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:21 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad145dc-9d8d-413d-b287-7ef32bada8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f', 'volume_size': 2}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f1c364-a50e-4d07-975b-823e31fae911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Volume volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f (d7a7c551-fdf3-4e07-ae5a-a4618471390f): created successfully
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f1c364-a50e-4d07-975b-823e31fae911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Flow 'volume_create_manager' (8096c383-ea6e-4b96-b3ff-64cf33e9caf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2d858c93-11df-4323-86c2-c32c026316d5 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Created volume successfully.
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Creating offline snapshot 6c890dc7-f739-45e6-ab8c-44d8f545d5c0 of volume d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d4aa6-e1dc-4074-a661-d9467ac16cc0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:22 devstack sudo[102331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f
Nov 05 03:54:22 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (ec35d067-90af-4949-9dab-765c433dda41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abba8ce-71a0-43ef-9c46-1fbaa24b5548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abba8ce-71a0-43ef-9c46-1fbaa24b5548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1484080621',display_name='tempest-VolumesGetTest-Volume-273475694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d32ea14-5d47-4e90-9fbe-a0b60a823fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:23Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c4f426-1796-43f9-a461-248703428c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c4f426-1796-43f9-a461-248703428c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:22 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f173dd83-cc62-4d00-9588-905576ee0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f173dd83-cc62-4d00-9588-905576ee0e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d32ea14-5d47-4e90-9fbe-a0b60a823fd1', 'volume_name': 'volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b343c62-20bb-4754-8d1b-a6e6a4328eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b343c62-20bb-4754-8d1b-a6e6a4328eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32993790-2288-48a4-af8f-bb39c6e095fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Volume 5d32ea14-5d47-4e90-9fbe-a0b60a823fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1', 'volume_size': 1}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f" returned: 0 in 0.612s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 2G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:22 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 2G
Nov 05 03:54:22 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:23 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 2G" returned: 0 in 0.652s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:23 devstack sudo[102342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0
Nov 05 03:54:23 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:23 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0" returned: 0 in 0.410s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:23 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 is being set with open permissions: ugo+rw
Nov 05 03:54:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:24 devstack sudo[102347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0
Nov 05 03:54:24 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:24 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:24 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info
Nov 05 03:54:24 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:24 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:24 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info is being set with open permissions: ugo+rw
Nov 05 03:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:24 devstack sudo[102354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info
Nov 05 03:54:24 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:24 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.info" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.129s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1484080621',display_name='tempest-VolumesGetTest-Volume-273475694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d32ea14-5d47-4e90-9fbe-a0b60a823fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:23Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Creating volume 5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:25 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:25 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 1073741824
Nov 05 03:54:25 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-143e215c-feaa-46b0-a0e2-c3c7a9f1e159 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Create snapshot completed successfully
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "cinder-6c890dc7-f739-45e6-ab8c-44d8f545d5c0-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-6c890dc7-f739-45e6-ab8c-44d8f545d5c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "cinder-quobyte-d7a7c551-fdf3-4e07-ae5a-a4618471390f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-quobyte-d7a7c551-fdf3-4e07-ae5a-a4618471390f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "cinder-quobyte-6c890dc7-f739-45e6-ab8c-44d8f545d5c0" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-quobyte-6c890dc7-f739-45e6-ab8c-44d8f545d5c0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Deleting offline snapshot 6c890dc7-f739-45e6-ab8c-44d8f545d5c0 of volume d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] snapshot_file for this snap is: volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c3b14-4255-40df-97a2-caf427e3b8f9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:25 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 1073741824" returned: 0 in 0.756s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:25 devstack sudo[102364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1
Nov 05 03:54:25 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:25 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0
Nov 05 03:54:25 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:26 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32993790-2288-48a4-af8f-bb39c6e095fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d951dd06-896b-44ab-91c8-3ff69d48b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Volume volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 (5d32ea14-5d47-4e90-9fbe-a0b60a823fd1): created successfully
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d951dd06-896b-44ab-91c8-3ff69d48b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (ec35d067-90af-4949-9dab-765c433dda41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:26 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:26 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-71938e4d-9ae5-4c7f-9486-aa5d6eb14f03 tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9dcb29-e1b6-42cf-872c-c723ca7fe72b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:26 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f
Nov 05 03:54:26 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:26 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:26 devstack sudo[102376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0
Nov 05 03:54:26 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Lock "cinder-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:27 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0" returned: 0 in 0.621s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:27 devstack sudo[102385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0
Nov 05 03:54:27 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1" acquired by "delete_volume" :: waited 0.049s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:27 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f.6c890dc7-f739-45e6-ab8c-44d8f545d5c0" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32cbd7c-946c-4999-a8b0-9f728dde1c71]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-quobyte-6c890dc7-f739-45e6-ab8c-44d8f545d5c0" released by "_delete_snapshot" :: held 2.230s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-quobyte-d7a7c551-fdf3-4e07-ae5a-a4618471390f" released by "delete_snapshot" :: held 2.288s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:28 devstack sudo[102388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1
Nov 05 03:54:28 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Created reservations ['17a53003-dd6c-4c58-ac00-3752f73098fb', 'cebdbfb2-aec6-452c-ac03-a5cfe32804f0', '0393e720-afe6-4612-a684-df46b5bfddb9', '5256852e-ce53-4d32-b5dd-9f782086fab7'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Delete snapshot completed successfully.
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cf16dd59-bdca-4743-a635-df4d5d6d85d2 tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-6c890dc7-f739-45e6-ab8c-44d8f545d5c0-delete_snapshot" released by "delete_snapshot" :: held 2.640s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:28 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1" returned: 0 in 0.645s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:28 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1
Nov 05 03:54:28 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:28 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1" released by "delete_volume" :: held 1.132s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Created reservations ['e0ea14a9-5fab-4b4b-9c44-3df8e0ba9b50', '6812d480-000d-435b-ab1d-cb4880c5c562', '63730374-bdd4-4391-a8f7-20a8a7c36a1d', '207617ce-c76c-4c95-b990-d6f36d789d4c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "cinder-d7a7c551-fdf3-4e07-ae5a-a4618471390f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-d7a7c551-fdf3-4e07-ae5a-a4618471390f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:29 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:29 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "cinder-quobyte-d7a7c551-fdf3-4e07-ae5a-a4618471390f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-quobyte-d7a7c551-fdf3-4e07-ae5a-a4618471390f" acquired by "delete_volume" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac25cec-1149-4e68-8306-2cbd9892f085]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:29 devstack sudo[102399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f
Nov 05 03:54:29 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:29 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-744c1fe7-7fdc-4e58-a3d5-06d78b58d7a9 tempest-VolumesGetTest-84301071 None] Lock "cinder-5d32ea14-5d47-4e90-9fbe-a0b60a823fd1-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-988987dd-2d3d-4369-a3c8-ef63b5b65f5a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Lock "cinder-988987dd-2d3d-4369-a3c8-ef63b5b65f5a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:29 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f" returned: 0 in 0.640s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:29 devstack sudo[102405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f
Nov 05 03:54:29 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-988987dd-2d3d-4369-a3c8-ef63b5b65f5a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-988987dd-2d3d-4369-a3c8-ef63b5b65f5a" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9635f-5aec-4deb-a120-4779b4160a7a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:30 devstack sudo[102407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a
Nov 05 03:54:30 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:30 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d7a7c551-fdf3-4e07-ae5a-a4618471390f" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-quobyte-d7a7c551-fdf3-4e07-ae5a-a4618471390f" released by "delete_volume" :: held 1.074s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Created reservations ['6eee83cd-4779-49f8-9f79-723280a9a040', '46701651-3891-41ee-9939-b023d3830205', '71736bec-d8be-44a1-87e2-02004ae683f5', 'f790b2a7-79b2-4559-9d27-a5398e9bef59'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:30 devstack sudo[102412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:30 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:30 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a" returned: 0 in 0.527s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:30 devstack sudo[102416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a
Nov 05 03:54:30 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:30 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Deleted volume successfully.
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a151271a-187a-49ae-926a-c5d1ffb0329b tempest-VolumesSnapshotNegativeTestJSON-472959045 None] Lock "cinder-d7a7c551-fdf3-4e07-ae5a-a4618471390f-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:30 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-988987dd-2d3d-4369-a3c8-ef63b5b65f5a" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-988987dd-2d3d-4369-a3c8-ef63b5b65f5a" released by "delete_volume" :: held 0.990s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Created reservations ['9886df09-ba05-4ca8-bde8-9b4e488df1b3', '0f97f1de-a558-4783-a5c2-d7d314426f1f', 'b09f0501-4e1b-40a0-bf81-306c95c4c4ce', '758a96b1-a6a2-4fc4-99e1-87d779ee88a5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:31 devstack sudo[102420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:31 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:31 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:54:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-af84ddbf-eb63-4c25-ab22-d48a7e953c8e tempest-VolumesGetTest-84301071 None] Lock "cinder-988987dd-2d3d-4369-a3c8-ef63b5b65f5a-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (06c79bd0-3d32-450a-a352-684f59ebee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec21cd40-46f1-4679-92c5-3b4de2451fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec21cd40-46f1-4679-92c5-3b4de2451fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1733834883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f04182-b978-43cf-838b-5609c4f7b63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:33Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b7856b-e005-43d0-8731-73838d6305d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b7856b-e005-43d0-8731-73838d6305d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53dd1226-a2c1-4e14-9b0e-dfed3a3232bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53dd1226-a2c1-4e14-9b0e-dfed3a3232bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f04182-b978-43cf-838b-5609c4f7b63f', 'volume_name': 'volume-95f04182-b978-43cf-838b-5609c4f7b63f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccdc154-a233-4ada-9c98-4cf5ded1bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccdc154-a233-4ada-9c98-4cf5ded1bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7f1ba4-3e05-4e36-8ce7-24e9ce0d88f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Volume 95f04182-b978-43cf-838b-5609c4f7b63f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f04182-b978-43cf-838b-5609c4f7b63f', 'volume_size': 1}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1733834883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f04182-b978-43cf-838b-5609c4f7b63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:33Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Creating volume 95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:32 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f 1073741824
Nov 05 03:54:32 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:33 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f 1073741824" returned: 0 in 0.795s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:33 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f
Nov 05 03:54:33 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:34 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f" returned: 0 in 0.370s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7f1ba4-3e05-4e36-8ce7-24e9ce0d88f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f04182-b978-43cf-838b-5609c4f7b63f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0975b8a9-4b87-4807-9685-61992b523672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Volume volume-95f04182-b978-43cf-838b-5609c4f7b63f (95f04182-b978-43cf-838b-5609c4f7b63f): created successfully
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0975b8a9-4b87-4807-9685-61992b523672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (06c79bd0-3d32-450a-a352-684f59ebee9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-da5c0cb0-9842-4064-b636-d3a0b4a9c4b3 tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Flow 'volume_create_manager' (7eb087b5-e792-49c4-8a3d-4a5fe70b8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ce7439-1d26-4481-99b9-5005b2f63fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ce7439-1d26-4481-99b9-5005b2f63fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a08c22-1773-446a-8daf-1838e21e5b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44002dc691644f099145e6a81fb828e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:35Z,use_quota=True,user_id='fee155d2689f4b3e9abe1dab068fb82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5ba6bb-4cfd-4264-8bdf-8d412c318f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5ba6bb-4cfd-4264-8bdf-8d412c318f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8d836f-370a-409a-a5ed-6e9e01c7ae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8d836f-370a-409a-a5ed-6e9e01c7ae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a08c22-1773-446a-8daf-1838e21e5b36', 'volume_name': 'volume-d6a08c22-1773-446a-8daf-1838e21e5b36', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdbcfc6-ea06-43a0-9973-c247a9a021b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdbcfc6-ea06-43a0-9973-c247a9a021b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c30c63-e947-4160-a30b-1580435a81ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Volume d6a08c22-1773-446a-8daf-1838e21e5b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a08c22-1773-446a-8daf-1838e21e5b36', 'volume_size': 1}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a08c22-1773-446a-8daf-1838e21e5b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44002dc691644f099145e6a81fb828e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:35Z,use_quota=True,user_id='fee155d2689f4b3e9abe1dab068fb82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Creating volume d6a08c22-1773-446a-8daf-1838e21e5b36 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:34 devstack sudo[102431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36 1073741824
Nov 05 03:54:34 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:35 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36 1073741824" returned: 0 in 0.692s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:35 devstack sudo[102437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36
Nov 05 03:54:35 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (6dbe6154-0e44-465f-9cc8-c10444201417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1617e72-9b32-4f08-a5ae-291d228aa655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1617e72-9b32-4f08-a5ae-291d228aa655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1819564176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d6bb6b-6def-4724-9767-d3c5a2e7625a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=95f04182-b978-43cf-838b-5609c4f7b63f,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:36Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983bda10-c5a6-4048-b22f-b754ab1db483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983bda10-c5a6-4048-b22f-b754ab1db483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab78abb2-66bb-465f-8710-906275bc8c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab78abb2-66bb-465f-8710-906275bc8c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '32d6bb6b-6def-4724-9767-d3c5a2e7625a', 'volume_name': 'volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a', 'volume_size': 1, 'source_volid': '95f04182-b978-43cf-838b-5609c4f7b63f', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c8e87f-f420-43e4-8899-3ee42caf0af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c8e87f-f420-43e4-8899-3ee42caf0af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc16fa8-be58-4abf-9dab-d598ad661f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Volume 32d6bb6b-6def-4724-9767-d3c5a2e7625a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a', 'volume_size': 1, 'source_volid': '95f04182-b978-43cf-838b-5609c4f7b63f', 'source_volstatus': 'available'}
Nov 05 03:54:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:36 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36" returned: 0 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.131s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Cloning volume 95f04182-b978-43cf-838b-5609c4f7b63f to volume 32d6bb6b-6def-4724-9767-d3c5a2e7625a
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c30c63-e947-4160-a30b-1580435a81ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a08c22-1773-446a-8daf-1838e21e5b36', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b2659c-f3dc-413e-907b-6f1ee4db3281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Volume volume-d6a08c22-1773-446a-8daf-1838e21e5b36 (d6a08c22-1773-446a-8daf-1838e21e5b36): created successfully
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b2659c-f3dc-413e-907b-6f1ee4db3281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Flow 'volume_create_manager' (7eb087b5-e792-49c4-8a3d-4a5fe70b8245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-faf3f93e-dca2-43a9-b3e0-bc5ff42c60ff tempest-CinderUnicodeTest-1174465338 None] Created volume successfully.
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Creating offline snapshot 7ad5d734-f528-4176-aab9-ba0f1133d473 of volume 95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e3bee0-ddba-47fb-94b3-495c95b53235]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:36 devstack sudo[102440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f
Nov 05 03:54:36 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:36 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f" returned: 0 in 0.529s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:36 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 1G
Nov 05 03:54:36 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:37 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 1G" returned: 0 in 0.704s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f04182-b978-43cf-838b-5609c4f7b63f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:37 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f04182-b978-43cf-838b-5609c4f7b63f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473
Nov 05 03:54:37 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:37 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Flow 'volume_create_manager' (dab6f5cb-e781-4a4d-8a15-42b37d03137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa97e3a-e645-46e2-a8d4-505c342d1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:38 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa97e3a-e645-46e2-a8d4-505c342d1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2083620977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59610da5-9729-4860-987d-650e4718c5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44002dc691644f099145e6a81fb828e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:38Z,use_quota=True,user_id='fee155d2689f4b3e9abe1dab068fb82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b020dd8-41b9-4924-b4ea-3c67cde9a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b020dd8-41b9-4924-b4ea-3c67cde9a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9adb63-5821-42c2-b8c0-70eaa774bb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9adb63-5821-42c2-b8c0-70eaa774bb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59610da5-9729-4860-987d-650e4718c5b2', 'volume_name': 'volume-59610da5-9729-4860-987d-650e4718c5b2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4829109d-9a49-4157-a050-9fbb0457decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4829109d-9a49-4157-a050-9fbb0457decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc821c4e-5e53-476f-a3bc-fe00de5eaf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Volume 59610da5-9729-4860-987d-650e4718c5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59610da5-9729-4860-987d-650e4718c5b2', 'volume_size': 1}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f04182-b978-43cf-838b-5609c4f7b63f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473" returned: 0 in 0.623s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 is being set with open permissions: ugo+rw
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:38 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473
Nov 05 03:54:38 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:38 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:38 devstack sudo[102461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info
Nov 05 03:54:38 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:38 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info" returned: 0 in 0.382s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info is being set with open permissions: ugo+rw
Nov 05 03:54:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:38 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info
Nov 05 03:54:38 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:39 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.info" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-32d6bb6b-6def-4724-9767-d3c5a2e7625a" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-32d6bb6b-6def-4724-9767-d3c5a2e7625a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] snapshot: 7ad5d734-f528-4176-aab9-ba0f1133d473, volume: 32d6bb6b-6def-4724-9767-d3c5a2e7625a,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2759961-1572-4399-b4ab-38d7a036b9b1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:39 devstack sudo[102467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473
Nov 05 03:54:39 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:39 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473" returned: 0 in 0.496s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f04182-b978-43cf-838b-5609c4f7b63f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7207a82f-8261-42a2-8990-73630fd32ae7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:39 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f
Nov 05 03:54:39 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:40 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f" returned: 0 in 0.521s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:54:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:54:40 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:54:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:40 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a
Nov 05 03:54:40 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=113,cinder:INSERT=34,cinder:UPDATE=120,cinder:DELETE=15 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=143,cinder:SELECT=100,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Flow 'volume_create_manager' (e93af77a-ad47-4660-abd6-9219aa90df56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aea058b-3fbe-4037-b51b-fa100e07a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aea058b-3fbe-4037-b51b-fa100e07a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-91457404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded497b1-1d35-465d-928c-524aba5c5529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35e922e170448aab6bf63610116aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:49Z,use_quota=True,user_id='cac6ec1cc112467ba3d0d0b42f75b697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08104e1-d3c0-4f3f-8cd3-6b6bc0ac10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08104e1-d3c0-4f3f-8cd3-6b6bc0ac10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dd88b8-7960-4c23-beb1-890bcbe87bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dd88b8-7960-4c23-beb1-890bcbe87bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded497b1-1d35-465d-928c-524aba5c5529', 'volume_name': 'volume-ded497b1-1d35-465d-928c-524aba5c5529', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5cfc36-c560-416c-b051-09b001663b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5cfc36-c560-416c-b051-09b001663b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f7f1a6-bb7f-4977-956b-6bae7e3d6d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Volume ded497b1-1d35-465d-928c-524aba5c5529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded497b1-1d35-465d-928c-524aba5c5529', 'volume_size': 1}
Nov 05 03:54:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:49 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a" returned: 0 in 9.285s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:54:49 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Converted 1024.00 MB image at 110.27 MB/s
Nov 05 03:54:49 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a is being set with open permissions: ugo+rw
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:49 devstack sudo[102495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a
Nov 05 03:54:49 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:49 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-32d6bb6b-6def-4724-9767-d3c5a2e7625a" released by "_copy_volume_from_snapshot" :: held 10.749s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-7ad5d734-f528-4176-aab9-ba0f1133d473" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-7ad5d734-f528-4176-aab9-ba0f1133d473" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Deleting offline snapshot 7ad5d734-f528-4176-aab9-ba0f1133d473 of volume 95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] snapshot_file for this snap is: volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8351d7be-e7b5-4fac-af06-8e9faaa671e6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:50 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473
Nov 05 03:54:50 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:50 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473" returned: 0 in 0.476s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f04182-b978-43cf-838b-5609c4f7b63f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba7c562-79c9-40d8-bba3-d61a75bb2a9c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:50 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f
Nov 05 03:54:50 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:51 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f" returned: 0 in 0.643s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:51 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473
Nov 05 03:54:51 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:51 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473" returned: 0 in 0.530s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:51 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473
Nov 05 03:54:51 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:52 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f.7ad5d734-f528-4176-aab9-ba0f1133d473" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-7ad5d734-f528-4176-aab9-ba0f1133d473" released by "_delete_snapshot" :: held 2.085s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.027s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.045s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2083620977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59610da5-9729-4860-987d-650e4718c5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44002dc691644f099145e6a81fb828e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:38Z,use_quota=True,user_id='fee155d2689f4b3e9abe1dab068fb82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Creating volume 59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:52 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc16fa8-be58-4abf-9dab-d598ad661f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a', 'volume_size': 1, 'source_volid': '95f04182-b978-43cf-838b-5609c4f7b63f', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:52 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 1073741824
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d77f1b9-fbf9-4520-b3fd-27989bfeaf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:52 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Volume volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a (32d6bb6b-6def-4724-9767-d3c5a2e7625a): created successfully
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d77f1b9-fbf9-4520-b3fd-27989bfeaf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (6dbe6154-0e44-465f-9cc8-c10444201417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b3a177fd-85e3-442d-95f5-06dcfce8623d tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:54:52 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 1073741824" returned: 0 in 0.758s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:52 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2
Nov 05 03:54:52 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:53 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.509s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-91457404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded497b1-1d35-465d-928c-524aba5c5529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35e922e170448aab6bf63610116aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:49Z,use_quota=True,user_id='cac6ec1cc112467ba3d0d0b42f75b697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Creating volume ded497b1-1d35-465d-928c-524aba5c5529 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc821c4e-5e53-476f-a3bc-fe00de5eaf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59610da5-9729-4860-987d-650e4718c5b2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4315d664-3433-4e05-bdec-377f16f5a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Volume volume-59610da5-9729-4860-987d-650e4718c5b2 (59610da5-9729-4860-987d-650e4718c5b2): created successfully
Nov 05 03:54:53 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529 1073741824
Nov 05 03:54:53 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4315d664-3433-4e05-bdec-377f16f5a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Flow 'volume_create_manager' (dab6f5cb-e781-4a4d-8a15-42b37d03137e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-eeac17ad-00d1-43f8-a79d-9354d0f46971 tempest-CinderUnicodeTest-1174465338 None] Created volume successfully.
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (9b7aa733-2914-4a6a-9f98-b68770c7faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a631ea-ac06-413b-ac89-3685733cd7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a631ea-ac06-413b-ac89-3685733cd7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1360670636',display_name='tempest-VolumesGetTest-Volume-1125679378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15138794-4ca9-4137-bf8c-59d0d772bc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:53Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1030d6e9-a362-4cc5-823e-2453dc643140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1030d6e9-a362-4cc5-823e-2453dc643140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2f3b72-cfe4-4db0-b625-6d7ec45e1a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2f3b72-cfe4-4db0-b625-6d7ec45e1a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15138794-4ca9-4137-bf8c-59d0d772bc4b', 'volume_name': 'volume-15138794-4ca9-4137-bf8c-59d0d772bc4b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f941ee5-f95f-408f-a50a-ee9f318997c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f941ee5-f95f-408f-a50a-ee9f318997c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f4aec6-6f01-418e-9fdc-d26bd8db44a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Volume 15138794-4ca9-4137-bf8c-59d0d772bc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15138794-4ca9-4137-bf8c-59d0d772bc4b', 'volume_size': 1}
Nov 05 03:54:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:54 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529 1073741824" returned: 0 in 0.756s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:54 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529
Nov 05 03:54:54 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:54 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1360670636',display_name='tempest-VolumesGetTest-Volume-1125679378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15138794-4ca9-4137-bf8c-59d0d772bc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:53Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Creating volume 15138794-4ca9-4137-bf8c-59d0d772bc4b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:54 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f7f1a6-bb7f-4977-956b-6bae7e3d6d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded497b1-1d35-465d-928c-524aba5c5529', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:54 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b 1073741824
Nov 05 03:54:54 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953c909c-8d66-4f9a-ab00-411b4b1eef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Volume volume-ded497b1-1d35-465d-928c-524aba5c5529 (ded497b1-1d35-465d-928c-524aba5c5529): created successfully
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953c909c-8d66-4f9a-ab00-411b4b1eef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Flow 'volume_create_manager' (e93af77a-ad47-4660-abd6-9219aa90df56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-80c73cca-5c4c-476e-ad1e-908db2b5d1ed tempest-VolumesListAdminTestJSON-1944487678 None] Created volume successfully.
Nov 05 03:54:55 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b 1073741824" returned: 0 in 0.603s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:55 devstack sudo[102541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b
Nov 05 03:54:55 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:55 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.316s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Creating offline snapshot 9e77a628-b865-48c1-bb39-b9ae11df71b8 of volume 59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f4aec6-6f01-418e-9fdc-d26bd8db44a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15138794-4ca9-4137-bf8c-59d0d772bc4b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8a2fdf-5d4f-45e9-bd6b-a7ff1d94199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3df169-0ed6-4921-9f1f-c7f5b118433f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Volume volume-15138794-4ca9-4137-bf8c-59d0d772bc4b (15138794-4ca9-4137-bf8c-59d0d772bc4b): created successfully
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8a2fdf-5d4f-45e9-bd6b-a7ff1d94199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (9b7aa733-2914-4a6a-9f98-b68770c7faad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Flow 'volume_create_manager' (c921af66-6016-4d01-8946-e60c87a7ade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0377d05-db34-476e-9f3a-088ff5e18949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f9c0b7e4-f396-4ae8-b9c2-885b8e0fcaac tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0377d05-db34-476e-9f3a-088ff5e18949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1142893369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35e922e170448aab6bf63610116aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:56Z,use_quota=True,user_id='cac6ec1cc112467ba3d0d0b42f75b697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71523b40-aef3-4e68-9806-31feaf7a17a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:55 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2
Nov 05 03:54:55 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71523b40-aef3-4e68-9806-31feaf7a17a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1e83da-5c4a-43f4-bee1-405846b83ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1e83da-5c4a-43f4-bee1-405846b83ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517', 'volume_name': 'volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0dce0-dd9c-4483-a4e3-f7bdd0ba2708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0dce0-dd9c-4483-a4e3-f7bdd0ba2708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e691425d-f289-4bad-8b03-b4dab7901670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Volume fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517', 'volume_size': 1}
Nov 05 03:54:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:56 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:56 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 1G
Nov 05 03:54:56 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:56 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 1G" returned: 0 in 0.579s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59610da5-9729-4860-987d-650e4718c5b2 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:56 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59610da5-9729-4860-987d-650e4718c5b2 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8
Nov 05 03:54:56 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-15138794-4ca9-4137-bf8c-59d0d772bc4b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Lock "cinder-15138794-4ca9-4137-bf8c-59d0d772bc4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-15138794-4ca9-4137-bf8c-59d0d772bc4b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-15138794-4ca9-4137-bf8c-59d0d772bc4b" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:57 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59610da5-9729-4860-987d-650e4718c5b2 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 is being set with open permissions: ugo+rw
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c02e7c-a0af-4b00-a88c-3c037c02e0eb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack sudo[102597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8
Nov 05 03:54:57 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b
Nov 05 03:54:57 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info
Nov 05 03:54:57 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b" returned: 0 in 0.480s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b
Nov 05 03:54:57 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info is being set with open permissions: ugo+rw
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:57 devstack sudo[102610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info
Nov 05 03:54:57 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:57 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-15138794-4ca9-4137-bf8c-59d0d772bc4b" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-15138794-4ca9-4137-bf8c-59d0d772bc4b" released by "delete_volume" :: held 0.867s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Created reservations ['be97c445-a89b-4c81-a17e-19edecbb2d50', '3b9e4eef-c54f-4e38-acb4-6adde8cd0ac3', 'bf70dd2e-7e5d-4ed9-9173-f6864aa983c8', '7dd7423b-3f2b-490c-8e85-1ddc1e83474d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:58 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.info" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:58 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:58 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.393s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1142893369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35e922e170448aab6bf63610116aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:56Z,use_quota=True,user_id='cac6ec1cc112467ba3d0d0b42f75b697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Creating volume fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:54:58 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bc7becf8-bef1-4e26-bb15-35e0a43030c2 tempest-CinderUnicodeTest-1174465338 None] Create snapshot completed successfully
Nov 05 03:54:58 devstack sudo[102616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 1073741824
Nov 05 03:54:58 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-32d6bb6b-6def-4724-9767-d3c5a2e7625a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Lock "cinder-32d6bb6b-6def-4724-9767-d3c5a2e7625a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-32d6bb6b-6def-4724-9767-d3c5a2e7625a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-32d6bb6b-6def-4724-9767-d3c5a2e7625a" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:58 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.376s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b56e7-a4ab-44ef-8d90-9f8af37cdd11]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ba3f4ba-7a8a-4214-bb04-95f35281bac8 tempest-VolumesGetTest-84301071 None] Lock "cinder-15138794-4ca9-4137-bf8c-59d0d772bc4b-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-9e77a628-b865-48c1-bb39-b9ae11df71b8-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-9e77a628-b865-48c1-bb39-b9ae11df71b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-quobyte-59610da5-9729-4860-987d-650e4718c5b2" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-59610da5-9729-4860-987d-650e4718c5b2" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-quobyte-9e77a628-b865-48c1-bb39-b9ae11df71b8" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:54:58 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a
Nov 05 03:54:58 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-9e77a628-b865-48c1-bb39-b9ae11df71b8" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Deleting offline snapshot 9e77a628-b865-48c1-bb39-b9ae11df71b8 of volume 59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] snapshot_file for this snap is: volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c410ac3-bbdb-4e00-98ea-5669e06f5524]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:58 devstack sudo[102624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8
Nov 05 03:54:58 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:58 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 1073741824" returned: 0 in 0.773s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:59 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517
Nov 05 03:54:59 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:59 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a" returned: 0 in 0.573s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:59 devstack sudo[102632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a
Nov 05 03:54:59 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:59 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8" returned: 0 in 0.541s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59610da5-9729-4860-987d-650e4718c5b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef458e23-ccda-4bad-8ff4-34b7dc4252d3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:59 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e691425d-f289-4bad-8b03-b4dab7901670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae2db9f-7f53-499d-a6a2-f905da458a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:54:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Volume volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 (fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517): created successfully
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae2db9f-7f53-499d-a6a2-f905da458a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Flow 'volume_create_manager' (c921af66-6016-4d01-8946-e60c87a7ade7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:54:59 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d6bb6b-6def-4724-9767-d3c5a2e7625a" returned: 0 in 0.396s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6440bf2-0736-4bf6-ae1f-27f377e1d752 tempest-VolumesListAdminTestJSON-1944487678 None] Created volume successfully.
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-32d6bb6b-6def-4724-9767-d3c5a2e7625a" released by "delete_volume" :: held 1.051s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:54:59 devstack sudo[102638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2
Nov 05 03:54:59 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Created reservations ['91fc8b79-f906-4eae-a12f-1fbb1cdd6f3b', '61cd7d83-ff7a-4934-bb6b-3bcbf5e0287e', '14b891b0-2087-4dad-867a-63ccb4608fc0', '215fca49-f032-42cf-a76a-61ff49cde9a6'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:59 devstack sudo[102641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:54:59 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:54:59 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2" returned: 0 in 0.615s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:54:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:54:59 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8
Nov 05 03:54:59 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:00 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c9a8a6e7-6022-42b0-80b8-6441f9e40d0c tempest-VolumesGetTest-84301071 None] Lock "cinder-32d6bb6b-6def-4724-9767-d3c5a2e7625a-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:00 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:00 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8
Nov 05 03:55:00 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Flow 'volume_create_manager' (b41a8e84-c77c-4692-9344-68b8ea3ce2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ad7b4-f7ce-41f8-b86d-1c677037c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ad7b4-f7ce-41f8-b86d-1c677037c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-817526179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25ae1f8-9106-4d27-9df9-ccedf1524578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35e922e170448aab6bf63610116aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:01Z,use_quota=True,user_id='cac6ec1cc112467ba3d0d0b42f75b697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a4a415-9580-4b22-8111-b716d553bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a4a415-9580-4b22-8111-b716d553bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d711ed-033d-40fe-bbc3-525e57d321e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d711ed-033d-40fe-bbc3-525e57d321e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25ae1f8-9106-4d27-9df9-ccedf1524578', 'volume_name': 'volume-c25ae1f8-9106-4d27-9df9-ccedf1524578', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61f1bc3-6880-4933-8a65-d777d714494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61f1bc3-6880-4933-8a65-d777d714494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7bd38-2e22-436a-9af0-9c375a4e6c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Volume c25ae1f8-9106-4d27-9df9-ccedf1524578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25ae1f8-9106-4d27-9df9-ccedf1524578', 'volume_size': 1}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-817526179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25ae1f8-9106-4d27-9df9-ccedf1524578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35e922e170448aab6bf63610116aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:01Z,use_quota=True,user_id='cac6ec1cc112467ba3d0d0b42f75b697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Creating volume c25ae1f8-9106-4d27-9df9-ccedf1524578 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-95f04182-b978-43cf-838b-5609c4f7b63f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2.9e77a628-b865-48c1-bb39-b9ae11df71b8" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:00 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Lock "cinder-95f04182-b978-43cf-838b-5609c4f7b63f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:00 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 1073741824
Nov 05 03:55:00 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-9e77a628-b865-48c1-bb39-b9ae11df71b8" released by "_delete_snapshot" :: held 2.292s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-59610da5-9729-4860-987d-650e4718c5b2" released by "delete_snapshot" :: held 2.337s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-95f04182-b978-43cf-838b-5609c4f7b63f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-95f04182-b978-43cf-838b-5609c4f7b63f" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e3b2f1-9cfc-43a5-b348-373d965d5634]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Created reservations ['e2170f7e-3d3e-419e-b7d6-93c856b22036', 'e24d5bb6-0fc5-40a2-a584-18f871271baa', '1be1e8f9-a188-471c-b15d-2c259fa7cea1', '77883897-21ed-455e-9249-5eb3018f07c2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Delete snapshot completed successfully.
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-45c5c597-0d7e-4d54-a9dc-ee9c15454422 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-9e77a628-b865-48c1-bb39-b9ae11df71b8-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:01 devstack sudo[102659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f
Nov 05 03:55:01 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:01 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 1073741824" returned: 0 in 0.670s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:01 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578
Nov 05 03:55:01 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:01 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:01 devstack sudo[102670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f
Nov 05 03:55:01 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:01 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578" returned: 0 in 0.350s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-59610da5-9729-4860-987d-650e4718c5b2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e7bd38-2e22-436a-9af0-9c375a4e6c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25ae1f8-9106-4d27-9df9-ccedf1524578', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b77907-87a1-4867-84de-9012769e5a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Volume volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 (c25ae1f8-9106-4d27-9df9-ccedf1524578): created successfully
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b77907-87a1-4867-84de-9012769e5a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Flow 'volume_create_manager' (b41a8e84-c77c-4692-9344-68b8ea3ce2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-59610da5-9729-4860-987d-650e4718c5b2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5f8a6b9a-293a-441a-8514-27f8807a119a tempest-VolumesListAdminTestJSON-1944487678 None] Created volume successfully.
Nov 05 03:55:02 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-95f04182-b978-43cf-838b-5609c4f7b63f" returned: 0 in 0.425s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-quobyte-59610da5-9729-4860-987d-650e4718c5b2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-95f04182-b978-43cf-838b-5609c4f7b63f" released by "delete_volume" :: held 1.085s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-59610da5-9729-4860-987d-650e4718c5b2" acquired by "delete_volume" :: waited 0.047s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85eff99-e0a7-4b39-a970-e287f6f41b5d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Created reservations ['c137fdf9-16e6-4507-a306-023544c260c3', '1612a572-93c3-49b5-abc2-9ab723591d59', '31021e97-41c7-40b2-a6a8-7eb341c2bf1c', '21cc7541-1df8-4f35-86c3-b7fe22d0de51'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:02 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2
Nov 05 03:55:02 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:02 devstack sudo[102679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:02 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:02 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:55:02 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2" returned: 0 in 0.588s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-47321512-0744-4711-8330-0535bddc21c5 tempest-VolumesGetTest-84301071 None] Lock "cinder-95f04182-b978-43cf-838b-5609c4f7b63f-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:02 devstack sudo[102685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2
Nov 05 03:55:02 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:03 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-59610da5-9729-4860-987d-650e4718c5b2" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-59610da5-9729-4860-987d-650e4718c5b2" released by "delete_volume" :: held 1.114s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Created reservations ['83efbfc9-c100-4d25-84d5-3a8d53c415fa', 'c917cb6f-94ad-41f8-ab6e-e495e6d80a17', 'fe84f636-7555-4f65-8c75-172245ad7f81', 'bdaa88c3-ca12-46a5-a580-0b3e2885b58e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:03 devstack sudo[102690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:03 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:04 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.514s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Deleted volume successfully.
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b3dac082-c80f-43eb-9b92-dca29f1f6968 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-59610da5-9729-4860-987d-650e4718c5b2-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Flow 'volume_create_manager' (cf1a51cb-f2a6-49b6-8674-dcb8e672f687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29ae714-42f0-47b4-8ab9-8aa7e6331cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29ae714-42f0-47b4-8ab9-8aa7e6331cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e25364-3b0a-4888-809d-d0f37caa0985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed7b416aba2465f891229111ea23198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:04Z,use_quota=True,user_id='154fd8efafdf40eba11a331a40d5fed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9b69f5-152e-43c7-94f3-f24973654f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9b69f5-152e-43c7-94f3-f24973654f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dbc979-e8c7-455e-aa4c-27b8d95ca228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dbc979-e8c7-455e-aa4c-27b8d95ca228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e25364-3b0a-4888-809d-d0f37caa0985', 'volume_name': 'volume-b7e25364-3b0a-4888-809d-d0f37caa0985', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976433d2-0993-440d-9171-eca507abb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976433d2-0993-440d-9171-eca507abb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a59ba7-9e9b-4ba8-8091-bd06c9b4ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Volume b7e25364-3b0a-4888-809d-d0f37caa0985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e25364-3b0a-4888-809d-d0f37caa0985', 'volume_size': 1}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e25364-3b0a-4888-809d-d0f37caa0985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ed7b416aba2465f891229111ea23198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:04Z,use_quota=True,user_id='154fd8efafdf40eba11a331a40d5fed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Creating volume b7e25364-3b0a-4888-809d-d0f37caa0985 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:04 devstack sudo[102699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985 1073741824
Nov 05 03:55:04 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-d6a08c22-1773-446a-8daf-1838e21e5b36-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-d6a08c22-1773-446a-8daf-1838e21e5b36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "cinder-quobyte-d6a08c22-1773-446a-8daf-1838e21e5b36" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-d6a08c22-1773-446a-8daf-1838e21e5b36" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4120af0c-f9a9-4fd2-944e-2a63922d4b46]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (c9b9dc10-9bc7-43b6-8456-f1aedbcb81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dee755e-c1b6-4895-b0d2-d73c65d27a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dee755e-c1b6-4895-b0d2-d73c65d27a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1187631784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18c088a-c56f-4c42-b921-68734a41ee8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:05Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c5fded-f5c0-4ff6-aa0d-a0cd98f8c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:05 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36
Nov 05 03:55:05 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c5fded-f5c0-4ff6-aa0d-a0cd98f8c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897bdbbf-1b08-4d88-955e-841b3155d457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:55:05 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985 1073741824" returned: 0 in 0.887s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:05 devstack sudo[102708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985
Nov 05 03:55:05 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:05 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36" returned: 0 in 0.890s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:05 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36
Nov 05 03:55:05 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897bdbbf-1b08-4d88-955e-841b3155d457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f18c088a-c56f-4c42-b921-68734a41ee8b', 'volume_name': 'volume-f18c088a-c56f-4c42-b921-68734a41ee8b', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7350e76b0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af23bce3-6e13-46a2-a7e1-f465887e7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af23bce3-6e13-46a2-a7e1-f465887e7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62164c24-4782-4f74-ac2e-24f400b43d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Volume f18c088a-c56f-4c42-b921-68734a41ee8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f18c088a-c56f-4c42-b921-68734a41ee8b', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7350e76b0>}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Trying to clone f18c088a-c56f-4c42-b921-68734a41ee8b from image b168d99d-9565-4249-9e41-af4fab9708fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:55:05 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a59ba7-9e9b-4ba8-8091-bd06c9b4ba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e25364-3b0a-4888-809d-d0f37caa0985', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424ea116-3609-4e73-b1ca-e6333bd4a8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:06 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d6a08c22-1773-446a-8daf-1838e21e5b36" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Volume volume-b7e25364-3b0a-4888-809d-d0f37caa0985 (b7e25364-3b0a-4888-809d-d0f37caa0985): created successfully
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424ea116-3609-4e73-b1ca-e6333bd4a8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Flow 'volume_create_manager' (cf1a51cb-f2a6-49b6-8674-dcb8e672f687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-quobyte-d6a08c22-1773-446a-8daf-1838e21e5b36" released by "delete_volume" :: held 1.454s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b027aec8-5f67-4e95-9af2-99d005d41ce5 tempest-VolumesListAdminTestJSON-1294255994 None] Created volume successfully.
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Created reservations ['39fc5f3b-4d95-45aa-9992-4e292535daad', 'd0c1f578-ac07-4c99-b502-51c7c570b1af', 'ce2fad4a-4b81-447c-8c07-276741836bd9', 'c0bb9881-9e06-44b1-a12e-fb6a7768591a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:55:06 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3942344e-b474-415b-8809-2beb1675c239]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:06 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:06 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Acquiring lock "cinder-b7e25364-3b0a-4888-809d-d0f37caa0985-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:06 devstack sudo[102717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Lock "cinder-b7e25364-3b0a-4888-809d-d0f37caa0985-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:06 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Acquiring lock "cinder-quobyte-b7e25364-3b0a-4888-809d-d0f37caa0985" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Lock "cinder-quobyte-b7e25364-3b0a-4888-809d-d0f37caa0985" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86eb7b5-028d-48e7-b1fa-c72a46ac7c10]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "cinder-c25ae1f8-9106-4d27-9df9-ccedf1524578-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-c25ae1f8-9106-4d27-9df9-ccedf1524578-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:07 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.611s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Deleted volume successfully.
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "cinder-quobyte-c25ae1f8-9106-4d27-9df9-ccedf1524578" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754f7f78-3a5f-432e-952c-fe3f6e552050 tempest-CinderUnicodeTest-1174465338 None] Lock "cinder-d6a08c22-1773-446a-8daf-1838e21e5b36-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-quobyte-c25ae1f8-9106-4d27-9df9-ccedf1524578" acquired by "delete_volume" :: waited 0.050s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:07 devstack sudo[102722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985
Nov 05 03:55:07 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb3aeb-eb26-4387-bcbc-72a303ebca5d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD" returned: 0 in 1.010s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb is fetched for user b433e5f04d1943b6a6699678c25d27a2. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:55:07 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578
Nov 05 03:55:07 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1568f18-6e8c-44d6-abe1-e5ed70d53a2c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985" returned: 0 in 0.721s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:07 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985
Nov 05 03:55:07 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:07 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD
Nov 05 03:55:07 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:08 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578" returned: 0 in 0.697s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:08 devstack sudo[102743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578
Nov 05 03:55:08 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:08 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e25364-3b0a-4888-809d-d0f37caa0985" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:08 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Lock "cinder-quobyte-b7e25364-3b0a-4888-809d-d0f37caa0985" released by "delete_volume" :: held 1.310s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1187631784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18c088a-c56f-4c42-b921-68734a41ee8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:05Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Creating volume f18c088a-c56f-4c42-b921-68734a41ee8b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:08 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:08 devstack sudo[102748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b 1073741824
Nov 05 03:55:08 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Created reservations ['e0a12a62-2e46-478d-885a-d5281af0c28d', '407de1a9-439c-475a-8b6e-77933cfff8b1', 'a94d46a7-defd-4b6a-87c8-3623b8b7bbc4', '0d367313-b9ef-4f44-9ec4-70063c2fef20'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:08 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c25ae1f8-9106-4d27-9df9-ccedf1524578" returned: 0 in 0.487s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-quobyte-c25ae1f8-9106-4d27-9df9-ccedf1524578" released by "delete_volume" :: held 1.306s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:08 devstack sudo[102751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:08 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:08 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:08 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Created reservations ['2f77bc52-1587-4e5f-8056-ef5016811f0f', '27e71667-fcfb-4007-a97d-554ef895b4c8', 'e579a346-1a84-483f-88f6-dc22892eeb1a', '58c38fdd-b38e-4949-b26b-446b1e4ee7a1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:09 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:09 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:09 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:09 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.638s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Deleted volume successfully.
Nov 05 03:55:09 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b 1073741824" returned: 0 in 1.068s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-abffa4fb-5bbc-4b30-a859-bc648c5043ed tempest-VolumesListAdminTestJSON-1294255994 None] Lock "cinder-b7e25364-3b0a-4888-809d-d0f37caa0985-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:09 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b
Nov 05 03:55:09 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:09 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "cinder-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.492s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Deleted volume successfully.
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8c706049-e2b7-4883-902f-35da98c40e3d tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-c25ae1f8-9106-4d27-9df9-ccedf1524578-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "cinder-quobyte-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-quobyte-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:09 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[864ec7ec-b663-462c-80ec-39b591b57484]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:09 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Attempting download of b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume f18c088a-c56f-4c42-b921-68734a41ee8b. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96918a-ae34-4e00-ae98-d339ea8e5fa4]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:10 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517
Nov 05 03:55:10 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:10 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6
Nov 05 03:55:10 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:10 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517" returned: 0 in 0.571s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:10 devstack sudo[102773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517
Nov 05 03:55:10 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:10 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6" returned: 0 in 0.574s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:10 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6
Nov 05 03:55:10 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:10 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-quobyte-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517" released by "delete_volume" :: held 1.040s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Created reservations ['f121e073-dca2-4037-8ad9-6527e3f0af99', '52512351-9abd-4938-90aa-70ad370298d5', 'cfe8ea5d-7347-44be-8199-cfbebcbd7ceb', 'ed39698c-f7fa-4664-bc6b-9356ef0fea45'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:11 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6" returned: 1 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b168d99d-9565-4249-9e41-af4fab9708fb_o77tk6d6' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2585e059-c06d-4c6b-a799-c578cebe501c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:11 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:11 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:11 devstack sudo[102783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD
Nov 05 03:55:11 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:11 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:11 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Deleted volume successfully.
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bb8ad0d6-3f12-4ebf-a0fc-85a0b6edfd32 tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-fc7ec9bf-6dc3-4539-bdd3-2e62b4b3e517-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:11 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] b168d99d-9565-4249-9e41-af4fab9708fb was qcow2, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:55:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:11 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b
Nov 05 03:55:11 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "cinder-ded497b1-1d35-465d-928c-524aba5c5529-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-ded497b1-1d35-465d-928c-524aba5c5529-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "cinder-quobyte-ded497b1-1d35-465d-928c-524aba5c5529" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-quobyte-ded497b1-1d35-465d-928c-524aba5c5529" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5bcef-2dbe-4cf3-9691-d57092810d34]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:12 devstack sudo[102797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529
Nov 05 03:55:12 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:12 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:12 devstack sudo[102810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529
Nov 05 03:55:12 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:13 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ded497b1-1d35-465d-928c-524aba5c5529" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-quobyte-ded497b1-1d35-465d-928c-524aba5c5529" released by "delete_volume" :: held 1.024s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Created reservations ['5aa79600-ae9f-4fe9-ae26-5ae98f5b2382', 'bec78adc-91f9-481b-9eab-74e67decc0ec', '5b1d7e42-911f-4ba1-bd15-9fefd63b50f8', 'fbeb3379-33c9-41f6-a8e4-7419d6956d20'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:13 devstack sudo[102813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:13 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:14 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.359s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:14 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:14 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Deleted volume successfully.
Nov 05 03:55:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-6ae35dc0-7817-4fca-84ae-00cd54d79fbf tempest-VolumesListAdminTestJSON-1944487678 None] Lock "cinder-ded497b1-1d35-465d-928c-524aba5c5529-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:14 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b" returned: 0 in 2.996s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:14 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b168d99d-9565-4249-9e41-af4fab9708fb_rutzuyh6devstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:55:14 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Converted 112.00 MB image at 37.36 MB/s
Nov 05 03:55:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:14 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b 1G
Nov 05 03:55:14 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:15 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b 1G" returned: 0 in 0.512s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Downloaded image b168d99d-9565-4249-9e41-af4fab9708fb ((None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}])) to volume f18c088a-c56f-4c42-b921-68734a41ee8b successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Temporary image b168d99d-9565-4249-9e41-af4fab9708fb for user b433e5f04d1943b6a6699678c25d27a2 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Marking volume f18c088a-c56f-4c42-b921-68734a41ee8b as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Copying metadata from image b168d99d-9565-4249-9e41-af4fab9708fb to f18c088a-c56f-4c42-b921-68734a41ee8b. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Creating volume glance metadata for volume f18c088a-c56f-4c42-b921-68734a41ee8b backed by image b168d99d-9565-4249-9e41-af4fab9708fb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62164c24-4782-4f74-ac2e-24f400b43d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18c088a-c56f-4c42-b921-68734a41ee8b', 'volume_size': 1, 'image_id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b168d99d-9565-4249-9e41-af4fab9708fb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c61049bf18374e38bff7b3d77432c61b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b168d99d-9565-4249-9e41-af4fab9708fb', 'created_at': datetime.datetime(2026, 11, 5, 2, 34, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 34, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b168d99d-9565-4249-9e41-af4fab9708fb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7350e76b0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74c3501-2eaa-48f2-9471-d323be1cdd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Volume volume-f18c088a-c56f-4c42-b921-68734a41ee8b (f18c088a-c56f-4c42-b921-68734a41ee8b): created successfully
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74c3501-2eaa-48f2-9471-d323be1cdd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (c9b9dc10-9bc7-43b6-8456-f1aedbcb81a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7ea16866-8e5b-460c-929b-a2b792711be8 tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (1a42db3a-55d5-413a-b2a8-101116a585cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba4cf90-7338-4559-b958-7ec20b442d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba4cf90-7338-4559-b958-7ec20b442d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748311379',display_name='tempest-VolumesGetTest-Volume-1884730200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fd7a0b-7f69-46ac-8a65-3727631c658a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:17Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c07cd-e2f8-4419-8dba-4b258f469328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c07cd-e2f8-4419-8dba-4b258f469328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fab586-cf58-48fa-9b98-9090c9034559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98fab586-cf58-48fa-9b98-9090c9034559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fd7a0b-7f69-46ac-8a65-3727631c658a', 'volume_name': 'volume-76fd7a0b-7f69-46ac-8a65-3727631c658a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e806a2-2a02-4bf0-995f-23f65dc8b3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e806a2-2a02-4bf0-995f-23f65dc8b3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f037f17-6be5-4500-b852-96ac29470eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Volume 76fd7a0b-7f69-46ac-8a65-3727631c658a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fd7a0b-7f69-46ac-8a65-3727631c658a', 'volume_size': 1}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748311379',display_name='tempest-VolumesGetTest-Volume-1884730200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fd7a0b-7f69-46ac-8a65-3727631c658a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56df7c2c6e14b9f9a6b7b2fa04d59f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:17Z,use_quota=True,user_id='b433e5f04d1943b6a6699678c25d27a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Creating volume 76fd7a0b-7f69-46ac-8a65-3727631c658a {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:17 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:17 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a 1073741824
Nov 05 03:55:17 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:17 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a 1073741824" returned: 0 in 0.723s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:17 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a
Nov 05 03:55:17 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:18 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a" returned: 0 in 0.572s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f037f17-6be5-4500-b852-96ac29470eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fd7a0b-7f69-46ac-8a65-3727631c658a', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802f6fa3-5ee2-4b95-b785-ef49bca60b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Volume volume-76fd7a0b-7f69-46ac-8a65-3727631c658a (76fd7a0b-7f69-46ac-8a65-3727631c658a): created successfully
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802f6fa3-5ee2-4b95-b785-ef49bca60b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Flow 'volume_create_manager' (1a42db3a-55d5-413a-b2a8-101116a585cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dee6bc1d-3838-4dea-9dcd-05997c39b7a1 tempest-VolumesGetTest-84301071 None] Created volume successfully.
Nov 05 03:55:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-76fd7a0b-7f69-46ac-8a65-3727631c658a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Lock "cinder-76fd7a0b-7f69-46ac-8a65-3727631c658a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-76fd7a0b-7f69-46ac-8a65-3727631c658a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-76fd7a0b-7f69-46ac-8a65-3727631c658a" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0025775e-e855-4212-a443-39059bc0dd9f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:19 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a
Nov 05 03:55:19 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:20 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:20 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a
Nov 05 03:55:20 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:20 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-76fd7a0b-7f69-46ac-8a65-3727631c658a" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-76fd7a0b-7f69-46ac-8a65-3727631c658a" released by "delete_volume" :: held 1.013s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Created reservations ['15646d4e-f67b-44b2-9416-fe48530903f8', '9ec8230d-94e0-4988-b632-8f6a63bb172f', 'b7aa5084-1a5e-4836-8984-597302a38445', '94c65015-b22c-4d27-a76f-4da6d9727c94'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:20 devstack sudo[103274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:20 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:21 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.438s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:21 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:55:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b2b6ad55-2468-434f-b289-b6dcaa8c0b2b tempest-VolumesGetTest-84301071 None] Lock "cinder-76fd7a0b-7f69-46ac-8a65-3727631c658a-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-f18c088a-c56f-4c42-b921-68734a41ee8b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Lock "cinder-f18c088a-c56f-4c42-b921-68734a41ee8b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Acquiring lock "cinder-quobyte-f18c088a-c56f-4c42-b921-68734a41ee8b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-f18c088a-c56f-4c42-b921-68734a41ee8b" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3edd3a-69d2-4a30-a8fc-bf80da5ad108]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:22 devstack sudo[103277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b
Nov 05 03:55:22 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:22 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b" returned: 0 in 0.492s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:22 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b
Nov 05 03:55:22 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:22 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f18c088a-c56f-4c42-b921-68734a41ee8b" returned: 0 in 0.389s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Lock "cinder-quobyte-f18c088a-c56f-4c42-b921-68734a41ee8b" released by "delete_volume" :: held 0.944s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Created reservations ['853331a3-c18d-41f8-beb4-a232ffaaaa58', 'a321e324-1bbf-4c38-be18-351f521eb2b9', '78756cfe-fc25-441a-b162-ca2ec95b967a', '769a6e3b-c89c-4397-97e4-9d262b2d3818'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:23 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:23 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:23 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.382s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Deleted volume successfully.
Nov 05 03:55:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-96044fa7-8c71-4dd9-a23a-80ca9c65a3e0 tempest-VolumesGetTest-84301071 None] Lock "cinder-f18c088a-c56f-4c42-b921-68734a41ee8b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:25 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Flow 'volume_create_manager' (1722a2fe-0a39-4158-8e2d-c70627362818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df7e57f-a409-491b-881e-b47a9c5ce50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df7e57f-a409-491b-881e-b47a9c5ce50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1697150397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80792e46-6802-42ec-91b7-5683e295f01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c28a8886ee454284295399d12247a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:26Z,use_quota=True,user_id='1197a62d20e44ddcaed749bfae0a16a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a25eff-e1f4-43fc-a4fd-efcbf54a65fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a25eff-e1f4-43fc-a4fd-efcbf54a65fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4b6490-07f0-4b3c-9125-e4534554b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4b6490-07f0-4b3c-9125-e4534554b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80792e46-6802-42ec-91b7-5683e295f01d', 'volume_name': 'volume-80792e46-6802-42ec-91b7-5683e295f01d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd99e38-f034-44b4-bfbe-d0d5d94dc982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd99e38-f034-44b4-bfbe-d0d5d94dc982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15bb2b9-76d1-4c2c-a04e-1334d7a66590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Volume 80792e46-6802-42ec-91b7-5683e295f01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80792e46-6802-42ec-91b7-5683e295f01d', 'volume_size': 1}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1697150397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80792e46-6802-42ec-91b7-5683e295f01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c28a8886ee454284295399d12247a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:26Z,use_quota=True,user_id='1197a62d20e44ddcaed749bfae0a16a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Creating volume 80792e46-6802-42ec-91b7-5683e295f01d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:26 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:26 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d 1073741824
Nov 05 03:55:26 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:26 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d 1073741824" returned: 0 in 0.831s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:27 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d
Nov 05 03:55:27 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:27 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15bb2b9-76d1-4c2c-a04e-1334d7a66590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80792e46-6802-42ec-91b7-5683e295f01d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2499e53b-5f5d-4cd4-b1e1-c99921fed828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Volume volume-80792e46-6802-42ec-91b7-5683e295f01d (80792e46-6802-42ec-91b7-5683e295f01d): created successfully
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2499e53b-5f5d-4cd4-b1e1-c99921fed828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Flow 'volume_create_manager' (1722a2fe-0a39-4158-8e2d-c70627362818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4493451f-dcc6-4b28-bfe2-a9ba89dadf1a tempest-VolumesTransfersTest-1819247311 None] Created volume successfully.
Nov 05 03:55:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0ac4353a-ab27-4ce3-aea6-bd7f3cf72662 tempest-VolumesTransfersTest-1264299773 None] Transfer volume completed successfully.
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Acquiring lock "cinder-80792e46-6802-42ec-91b7-5683e295f01d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-80792e46-6802-42ec-91b7-5683e295f01d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Acquiring lock "cinder-quobyte-80792e46-6802-42ec-91b7-5683e295f01d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-quobyte-80792e46-6802-42ec-91b7-5683e295f01d" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d551f3-fb0f-426c-b431-08c6f72acb3c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:31 devstack sudo[103382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d
Nov 05 03:55:31 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:31 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d" returned: 0 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:31 devstack sudo[103387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d
Nov 05 03:55:31 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Flow 'volume_create_manager' (9fd5fdbb-ff4f-4a18-9563-d3720176b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5484d795-32f8-410f-8150-30c1f06af8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5484d795-32f8-410f-8150-30c1f06af8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1048654500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcae478-afa2-4e3b-8d7c-34c84219ec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2856ff2c01741a5a08fce0aa57e5c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:32Z,use_quota=True,user_id='73bc11e87fbc4f57b599df67f0baecfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112e9126-1348-4eaf-8a87-36ec6a98516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112e9126-1348-4eaf-8a87-36ec6a98516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee5a259-f179-4e93-b06e-4e104c851bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee5a259-f179-4e93-b06e-4e104c851bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fcae478-afa2-4e3b-8d7c-34c84219ec26', 'volume_name': 'volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c40f90-72aa-4888-95ad-b669c64088ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c40f90-72aa-4888-95ad-b669c64088ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0102470-b8e8-4771-85c8-727578abec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26', 'volume_size': 1}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1048654500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fcae478-afa2-4e3b-8d7c-34c84219ec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2856ff2c01741a5a08fce0aa57e5c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:32Z,use_quota=True,user_id='73bc11e87fbc4f57b599df67f0baecfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Creating volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:32 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 1073741824
Nov 05 03:55:32 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-80792e46-6802-42ec-91b7-5683e295f01d" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-quobyte-80792e46-6802-42ec-91b7-5683e295f01d" released by "delete_volume" :: held 0.944s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Created reservations ['6105afca-d58b-4b30-ab3e-831b9c4ddb59', 'ccbaf4d0-2769-4cb3-91f7-34f9b009a07c', 'f9f08541-82a8-47e8-904c-ed3005b21aca', '1349b31f-b156-4e87-9007-0dc5dc60d811'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:32 devstack sudo[103395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:32 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 1073741824" returned: 0 in 0.659s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:32 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:32 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26
Nov 05 03:55:32 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Deleted volume successfully.
Nov 05 03:55:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-810ad774-7e33-4b8a-ad2d-fe75d745c1a9 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-80792e46-6802-42ec-91b7-5683e295f01d-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:33 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0102470-b8e8-4771-85c8-727578abec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae2d1d8-971c-485e-b470-e68e695a9702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Volume volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 (1fcae478-afa2-4e3b-8d7c-34c84219ec26): created successfully
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae2d1d8-971c-485e-b470-e68e695a9702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Flow 'volume_create_manager' (9fd5fdbb-ff4f-4a18-9563-d3720176b837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-275e0d4d-0e9e-4589-935e-021fa923b3e1 tempest-VolumesSnapshotListTestJSON-810101172 None] Created volume successfully.
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Flow 'volume_create_manager' (dd85ad6c-1d96-4f54-afff-d7a186119f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a254e3b2-6288-4840-be20-985a6922d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a254e3b2-6288-4840-be20-985a6922d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-349037729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed63a87-df33-401c-b893-eff40fd03446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c28a8886ee454284295399d12247a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:34Z,use_quota=True,user_id='1197a62d20e44ddcaed749bfae0a16a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415fba42-707c-4afb-a271-fb88bb29c9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415fba42-707c-4afb-a271-fb88bb29c9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3ab4c4-f96e-4515-b1b5-06e21b65a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3ab4c4-f96e-4515-b1b5-06e21b65a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed63a87-df33-401c-b893-eff40fd03446', 'volume_name': 'volume-3ed63a87-df33-401c-b893-eff40fd03446', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1078c3ef-9193-4579-b7da-089549745e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1078c3ef-9193-4579-b7da-089549745e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2531697b-e45b-49f2-8c32-824fc4f46a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Volume 3ed63a87-df33-401c-b893-eff40fd03446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed63a87-df33-401c-b893-eff40fd03446', 'volume_size': 1}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-349037729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed63a87-df33-401c-b893-eff40fd03446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56c28a8886ee454284295399d12247a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:34Z,use_quota=True,user_id='1197a62d20e44ddcaed749bfae0a16a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Creating volume 3ed63a87-df33-401c-b893-eff40fd03446 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:34 devstack sudo[103402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446 1073741824
Nov 05 03:55:34 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:34 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446 1073741824" returned: 0 in 0.571s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:34 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446
Nov 05 03:55:34 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:35 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.773s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2531697b-e45b-49f2-8c32-824fc4f46a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed63a87-df33-401c-b893-eff40fd03446', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4aab70-a81c-40ce-a233-ed14f18e7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Creating offline snapshot 8a31c63e-d77e-4f9f-a551-164f18154352 of volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Volume volume-3ed63a87-df33-401c-b893-eff40fd03446 (3ed63a87-df33-401c-b893-eff40fd03446): created successfully
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4aab70-a81c-40ce-a233-ed14f18e7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Flow 'volume_create_manager' (dd85ad6c-1d96-4f54-afff-d7a186119f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d596d2e1-bde8-4c81-a82f-77649d2989f5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-51ce6db4-54f0-4698-b9f1-4be24fb4b895 tempest-VolumesTransfersTest-1819247311 None] Created volume successfully.
Nov 05 03:55:35 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26
Nov 05 03:55:35 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:35 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26" returned: 0 in 0.421s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:35 devstack sudo[103415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 1G
Nov 05 03:55:35 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:36 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 1G" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:36 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:36 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:36 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.429s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:36 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 is being set with open permissions: ugo+rw
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:36 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:36 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Acquiring lock "cinder-3ed63a87-df33-401c-b893-eff40fd03446-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-3ed63a87-df33-401c-b893-eff40fd03446-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Acquiring lock "cinder-quobyte-3ed63a87-df33-401c-b893-eff40fd03446" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-quobyte-3ed63a87-df33-401c-b893-eff40fd03446" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb188da-521b-47ce-81b0-0769a41f9f06]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:36 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:37 devstack sudo[103428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446
Nov 05 03:55:37 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:37 devstack sudo[103430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info
Nov 05 03:55:37 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:37 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:37 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info is being set with open permissions: ugo+rw
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:37 devstack sudo[103438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info
Nov 05 03:55:37 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:37 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:37 devstack sudo[103440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446
Nov 05 03:55:37 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:37 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:37 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.info" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3ed63a87-df33-401c-b893-eff40fd03446" returned: 0 in 0.376s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-quobyte-3ed63a87-df33-401c-b893-eff40fd03446" released by "delete_volume" :: held 0.939s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4ae4c107-aeec-4ff7-a90c-c45b90e3a093 tempest-VolumesSnapshotListTestJSON-810101172 None] Create snapshot completed successfully
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Created reservations ['7d59c4d0-9c28-4a87-b2fa-c7e2e83c5807', '829f1ce5-5e3d-4772-84f5-8305ac51032d', 'd46d9912-102b-48c0-9766-e9d911734224', '36ae8a67-8984-46f0-990c-f81a06e0f86a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:38 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:38 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:38 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Deleted volume successfully.
Nov 05 03:55:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7ec950e9-67bd-4c98-9593-f972bc738b43 tempest-VolumesTransfersTest-1294238169 None] Lock "cinder-3ed63a87-df33-401c-b893-eff40fd03446-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Creating offline snapshot 2cf25a12-0a35-4433-875d-bf80a374d6c3 of volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:39 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb6b01-8ddc-4039-a9b7-eea8c8323538]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:39 devstack sudo[103447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:39 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:39 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.473s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:39 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 1G
Nov 05 03:55:39 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:40 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 1G" returned: 0 in 0.671s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:40 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:40 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:40 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:40 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 is being set with open permissions: ugo+rw
Nov 05 03:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:40 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:40 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:40 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.302s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-30fa5871-7805-4d52-957b-2a7bec7262fa tempest-VolumesSnapshotListTestJSON-810101172 None] Create snapshot completed successfully
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Creating offline snapshot 9448fe68-d050-4583-b189-05e8690d5e59 of volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d0642-68a3-482e-bf90-8d69d1b437ee]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:41 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:41 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:41 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.468s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:41 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 1G
Nov 05 03:55:41 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:42 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 1G" returned: 0 in 0.607s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:42 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59
Nov 05 03:55:42 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:42 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:42 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 is being set with open permissions: ugo+rw
Nov 05 03:55:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:42 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59
Nov 05 03:55:42 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:43 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d7b46aa4-edac-419a-b525-db84d452a992 tempest-VolumesSnapshotListTestJSON-810101172 None] Create snapshot completed successfully
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-9448fe68-d050-4583-b189-05e8690d5e59-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-9448fe68-d050-4583-b189-05e8690d5e59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-9448fe68-d050-4583-b189-05e8690d5e59" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-9448fe68-d050-4583-b189-05e8690d5e59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Deleting offline snapshot 9448fe68-d050-4583-b189-05e8690d5e59 of volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] snapshot_file for this snap is: volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac1373-9c57-4d79-b39d-4f435b6c2a50]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:44 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59
Nov 05 03:55:44 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:45 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59" returned: 0 in 0.430s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[917bceb0-8f24-46ae-b2a8-edc5b752f4d7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:45 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:45 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:45 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:45 devstack sudo[103527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59
Nov 05 03:55:45 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59" returned: 0 in 0.571s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:46 devstack sudo[103534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59
Nov 05 03:55:46 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:46 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.9448fe68-d050-4583-b189-05e8690d5e59" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-9448fe68-d050-4583-b189-05e8690d5e59" released by "_delete_snapshot" :: held 1.919s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" released by "delete_snapshot" :: held 1.950s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Created reservations ['55b71680-6106-4f63-8900-75a885d6a4e7', '974676c3-1c66-42d4-98a0-cea5d1b7febf', '0ffdb268-e4cf-4b0b-b2f5-76715f340434', 'd8912829-53b4-4bee-94d4-aac5763c7684'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Delete snapshot completed successfully.
Nov 05 03:55:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-3fbe3ff1-c3fc-42b0-ad9c-8b1f07e4f94e tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-9448fe68-d050-4583-b189-05e8690d5e59-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-2cf25a12-0a35-4433-875d-bf80a374d6c3-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-2cf25a12-0a35-4433-875d-bf80a374d6c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-2cf25a12-0a35-4433-875d-bf80a374d6c3" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-2cf25a12-0a35-4433-875d-bf80a374d6c3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Deleting offline snapshot 2cf25a12-0a35-4433-875d-bf80a374d6c3 of volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] snapshot_file for this snap is: volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[87467124-af14-406b-8c83-829c6a9da8b1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:48 devstack sudo[103538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:48 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:48 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf6f435-e220-4386-9384-bd67dd0eea3f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:48 devstack sudo[103543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:48 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=165,cinder:SELECT=120,cinder:DELETE=14,cinder:INSERT=40 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=142,cinder:UPDATE=152,cinder:INSERT=47,cinder:DELETE=15 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:55:48 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Flow 'volume_create_manager' (45cecc80-d3b2-424e-9f5b-2a1ee3b31251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79963607-5315-409a-a1e6-193cf199ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79963607-5315-409a-a1e6-193cf199ee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1201138931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845067d6-0b17-47b6-b4e0-b09b30a4cd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dff9c784454b81baaea065fc7c07fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:49Z,use_quota=True,user_id='23fb7866f31949369b59349419d0e3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbb412e-6d2d-4f46-b19d-bc5161b38312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbb412e-6d2d-4f46-b19d-bc5161b38312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc68f56-fd87-4fe1-93e5-1d4fd6c4d9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc68f56-fd87-4fe1-93e5-1d4fd6c4d9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845067d6-0b17-47b6-b4e0-b09b30a4cd3b', 'volume_name': 'volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6572367a-fa9a-44dc-8bc8-5e9d03f50433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6572367a-fa9a-44dc-8bc8-5e9d03f50433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a833c0f-1e43-425e-8982-46368152732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Volume 845067d6-0b17-47b6-b4e0-b09b30a4cd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b', 'volume_size': 1}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1201138931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845067d6-0b17-47b6-b4e0-b09b30a4cd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dff9c784454b81baaea065fc7c07fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:49Z,use_quota=True,user_id='23fb7866f31949369b59349419d0e3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Creating volume 845067d6-0b17-47b6-b4e0-b09b30a4cd3b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:49 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.503s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b 1073741824
Nov 05 03:55:49 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:49 devstack sudo[103549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:49 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:49 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3
Nov 05 03:55:49 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:49 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b 1073741824" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:49 devstack sudo[103562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b
Nov 05 03:55:49 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:49 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.2cf25a12-0a35-4433-875d-bf80a374d6c3" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-2cf25a12-0a35-4433-875d-bf80a374d6c3" released by "_delete_snapshot" :: held 1.890s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" released by "delete_snapshot" :: held 1.921s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:49 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a833c0f-1e43-425e-8982-46368152732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7911262-317f-4266-912d-726e01412e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Volume volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b (845067d6-0b17-47b6-b4e0-b09b30a4cd3b): created successfully
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7911262-317f-4266-912d-726e01412e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Flow 'volume_create_manager' (45cecc80-d3b2-424e-9f5b-2a1ee3b31251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-13273a49-c8ea-494d-8836-93d314a90c44 tempest-VolumesTransfersV355Test-1193435970 None] Created volume successfully.
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Created reservations ['d89efc19-467c-47ce-a1ec-2b817ea41ac8', '6504a621-3bf1-4dd5-a26d-295f493cfed2', 'cbae263c-5c93-461f-ab46-d4d6926142b7', '8f6a4d2d-a1ea-493c-867a-9130f16403dd'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Delete snapshot completed successfully.
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-28bde06d-43f8-42fb-a905-6e6f79ce0c36 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-2cf25a12-0a35-4433-875d-bf80a374d6c3-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-8a31c63e-d77e-4f9f-a551-164f18154352-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-8a31c63e-d77e-4f9f-a551-164f18154352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-8a31c63e-d77e-4f9f-a551-164f18154352" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-8a31c63e-d77e-4f9f-a551-164f18154352" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Deleting offline snapshot 8a31c63e-d77e-4f9f-a551-164f18154352 of volume 1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] snapshot_file for this snap is: volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[651cd8c8-203b-4bd6-ab0d-bd05faa65fc1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:50 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:50 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:50 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aa40d0-b645-40b0-91c8-4bf15b4215e3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:51 devstack sudo[103573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26
Nov 05 03:55:51 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Flow 'volume_create_manager' (bb4cea7c-83e1-4ecb-bbc2-f6e5d68cea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07310695-ff56-4d59-a600-c2d2d0ffc77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:51 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07310695-ff56-4d59-a600-c2d2d0ffc77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1734771496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c964fcc6-75df-4c70-a0e7-ec285f2ea1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb1562529c84d84b2f80c3c53b5f380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:51Z,use_quota=True,user_id='8a52099861074456aeb10b5557223e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:51 devstack sudo[103578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:51 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08065a4-a5d7-4515-b6ef-c190a8c1902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08065a4-a5d7-4515-b6ef-c190a8c1902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805d1444-a913-484e-ad22-541a5a21193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805d1444-a913-484e-ad22-541a5a21193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c964fcc6-75df-4c70-a0e7-ec285f2ea1fc', 'volume_name': 'volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9845712-0892-4363-b562-5c31df1fce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9845712-0892-4363-b562-5c31df1fce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f7ec0c-c1e8-4467-b2a6-e7681db979fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Volume c964fcc6-75df-4c70-a0e7-ec285f2ea1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc', 'volume_size': 1}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1734771496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c964fcc6-75df-4c70-a0e7-ec285f2ea1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb1562529c84d84b2f80c3c53b5f380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:51Z,use_quota=True,user_id='8a52099861074456aeb10b5557223e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Creating volume c964fcc6-75df-4c70-a0e7-ec285f2ea1fc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:51 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:51 devstack sudo[103580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc 1073741824
Nov 05 03:55:51 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:51 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:51 devstack sudo[103588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352
Nov 05 03:55:51 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7f5dd233-c55f-41a3-9a7a-37bab5b819a9 tempest-VolumesTransfersV355Test-918973035 None] Transfer volume completed successfully.
Nov 05 03:55:52 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc 1073741824" returned: 0 in 0.619s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:52 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26.8a31c63e-d77e-4f9f-a551-164f18154352" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:52 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc
Nov 05 03:55:52 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-8a31c63e-d77e-4f9f-a551-164f18154352" released by "_delete_snapshot" :: held 1.849s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" released by "delete_snapshot" :: held 1.880s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Created reservations ['245722e4-426f-4221-a4f6-74c65e08a380', 'e3a3a611-4b8a-4796-b16d-520b9116e321', 'ecacfceb-3fd9-4be2-943d-36a4c18f8bbe', '423742ee-e02c-40bf-8caf-aa71d7a45fee'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Delete snapshot completed successfully.
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fdf74f0b-5afd-4b3e-9845-4755d4063986 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-8a31c63e-d77e-4f9f-a551-164f18154352-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:52 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f7ec0c-c1e8-4467-b2a6-e7681db979fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad96025-543b-4ef9-ae28-89d861dbdae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Volume volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc (c964fcc6-75df-4c70-a0e7-ec285f2ea1fc): created successfully
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad96025-543b-4ef9-ae28-89d861dbdae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Flow 'volume_create_manager' (bb4cea7c-83e1-4ecb-bbc2-f6e5d68cea18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6321d0aa-6d5d-4305-abe0-8aba202bd230 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Created volume successfully.
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-1fcae478-afa2-4e3b-8d7c-34c84219ec26-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-1fcae478-afa2-4e3b-8d7c-34c84219ec26-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Acquiring lock "cinder-845067d6-0b17-47b6-b4e0-b09b30a4cd3b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-845067d6-0b17-47b6-b4e0-b09b30a4cd3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f9a53-9c1a-48af-9792-c5e696d19ae7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Acquiring lock "cinder-quobyte-845067d6-0b17-47b6-b4e0-b09b30a4cd3b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-quobyte-845067d6-0b17-47b6-b4e0-b09b30a4cd3b" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c128d-91de-4e64-b9a1-3e52f5b5a769]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:52 devstack sudo[103595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26
Nov 05 03:55:52 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:52 devstack sudo[103596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b
Nov 05 03:55:52 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26" returned: 0 in 0.433s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[103602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26
Nov 05 03:55:53 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b
Nov 05 03:55:53 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1fcae478-afa2-4e3b-8d7c-34c84219ec26" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-quobyte-1fcae478-afa2-4e3b-8d7c-34c84219ec26" released by "delete_volume" :: held 0.870s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Created reservations ['4217ab0a-b636-4f86-942c-07894cefae23', '12cf470f-6ef6-42a2-8427-e8fba10f8327', '78a585dc-40ff-4b49-a7ea-b87a9396ff43', '0c825675-6c82-473f-8c77-46fe1df32268'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:53 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-845067d6-0b17-47b6-b4e0-b09b30a4cd3b" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-quobyte-845067d6-0b17-47b6-b4e0-b09b30a4cd3b" released by "delete_volume" :: held 0.884s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:53 devstack sudo[103614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:53 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Created reservations ['59a1557c-75f9-4d57-aea1-4d31451be5e0', '05062e73-4a34-4d68-8f46-1d0a8af3eb92', 'df8748e3-3b11-496e-99ca-26b5c14a3584', '961c80b6-4da8-44fe-ba22-31462221ac87'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:54 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:54 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:54 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.473s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Deleted volume successfully.
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4dd0f418-d5e6-43a2-b133-71b2ece3b877 tempest-VolumesSnapshotListTestJSON-810101172 None] Lock "cinder-1fcae478-afa2-4e3b-8d7c-34c84219ec26-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:54 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.343s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:55:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Deleted volume successfully.
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2a1c5b9-a5aa-491e-a6a3-5633fe93513d tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-845067d6-0b17-47b6-b4e0-b09b30a4cd3b-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-14a2b477-434d-4498-af57-4b25896961ee req-a47a8f74-bf7a-432c-b3fd-716c0833329e tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-14a2b477-434d-4498-af57-4b25896961ee req-a47a8f74-bf7a-432c-b3fd-716c0833329e tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-14a2b477-434d-4498-af57-4b25896961ee req-a47a8f74-bf7a-432c-b3fd-716c0833329e tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-14a2b477-434d-4498-af57-4b25896961ee req-a47a8f74-bf7a-432c-b3fd-716c0833329e tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6ee5157-f32d-4eb6-861d-8f6d2a81d798', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:55:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-14a2b477-434d-4498-af57-4b25896961ee req-a47a8f74-bf7a-432c-b3fd-716c0833329e tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] attachment_update completed successfully.
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Flow 'volume_create_manager' (c3c42748-40a0-4891-b869-61ebc18d628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b191505b-39da-40ab-88f0-9209ecf1c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b191505b-39da-40ab-88f0-9209ecf1c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1482443932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d678cd-330a-4913-86a9-d16d5dcfd769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dff9c784454b81baaea065fc7c07fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:56Z,use_quota=True,user_id='23fb7866f31949369b59349419d0e3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3ea114-4117-48f0-b436-f684789cb9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3ea114-4117-48f0-b436-f684789cb9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ae2e0c-b792-4b76-a689-a4fcff66285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ae2e0c-b792-4b76-a689-a4fcff66285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d678cd-330a-4913-86a9-d16d5dcfd769', 'volume_name': 'volume-32d678cd-330a-4913-86a9-d16d5dcfd769', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac263b9-a243-4bf0-aebf-cfafd880cd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac263b9-a243-4bf0-aebf-cfafd880cd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6a75ba-0000-4675-a7a8-5b4a90083b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Volume 32d678cd-330a-4913-86a9-d16d5dcfd769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d678cd-330a-4913-86a9-d16d5dcfd769', 'volume_size': 1}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1482443932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d678cd-330a-4913-86a9-d16d5dcfd769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2dff9c784454b81baaea065fc7c07fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:56Z,use_quota=True,user_id='23fb7866f31949369b59349419d0e3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Creating volume 32d678cd-330a-4913-86a9-d16d5dcfd769 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:55:55 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:55:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:55 devstack sudo[104044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769 1073741824
Nov 05 03:55:55 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:56 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769 1073741824" returned: 0 in 0.551s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:56 devstack sudo[104050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769
Nov 05 03:55:56 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:56 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6a75ba-0000-4675-a7a8-5b4a90083b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d678cd-330a-4913-86a9-d16d5dcfd769', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb57bcb6-fd99-4ccb-ad31-7d5849a28eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:55:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Volume volume-32d678cd-330a-4913-86a9-d16d5dcfd769 (32d678cd-330a-4913-86a9-d16d5dcfd769): created successfully
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb57bcb6-fd99-4ccb-ad31-7d5849a28eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:55:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Flow 'volume_create_manager' (c3c42748-40a0-4891-b869-61ebc18d628a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:55:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3d0cba57-2609-4c00-8774-29998b5fd38f tempest-VolumesTransfersV355Test-1193435970 None] Created volume successfully.
Nov 05 03:55:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-7b343325-b708-44c9-b02f-c78ba76bc68a req-a5d4edca-92cd-4496-8d83-19a747da05ae tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Terminate volume connection completed successfully.
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-7b343325-b708-44c9-b02f-c78ba76bc68a req-a5d4edca-92cd-4496-8d83-19a747da05ae tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Deleting attachment b6ee5157-f32d-4eb6-861d-8f6d2a81d798. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Acquiring lock "cinder-32d678cd-330a-4913-86a9-d16d5dcfd769-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-32d678cd-330a-4913-86a9-d16d5dcfd769-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Acquiring lock "cinder-quobyte-32d678cd-330a-4913-86a9-d16d5dcfd769" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-quobyte-32d678cd-330a-4913-86a9-d16d5dcfd769" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ea7aa-3512-43ab-b567-bc6fc95b13c0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:58 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769
Nov 05 03:55:58 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:59 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:59 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769
Nov 05 03:55:59 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Acquiring lock "cinder-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "cinder-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Acquiring lock "cinder-quobyte-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "cinder-quobyte-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:55:59 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-32d678cd-330a-4913-86a9-d16d5dcfd769" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-quobyte-32d678cd-330a-4913-86a9-d16d5dcfd769" released by "delete_volume" :: held 0.920s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd586c-8f97-466f-ae91-8d588f7330b1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Created reservations ['2254a14d-b8bc-4823-9559-7f66c47acc9e', '98a24bee-17ab-4e5b-a94e-91b7002365e5', '35ae0858-0932-4cf3-bb63-3cc3b231b1d3', 'fd54ac5a-ad63-49a6-9376-57fa8e6794bd'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:55:59 devstack sudo[104127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc
Nov 05 03:55:59 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:59 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:55:59 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:55:59 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:55:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:55:59 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc
Nov 05 03:55:59 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:00 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Deleted volume successfully.
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-840155d5-c37c-4561-beba-a42916669067 tempest-VolumesTransfersV355Test-707159113 None] Lock "cinder-32d678cd-330a-4913-86a9-d16d5dcfd769-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:00 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "cinder-quobyte-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc" released by "delete_volume" :: held 0.836s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Created reservations ['2570deba-b45b-45ce-8ee7-4e9fd5acebe5', '40dc7969-47e7-444b-8dfe-eb5b675c9fd1', '1d030ddb-3be5-4626-8295-4b158eb4bb23', '1cae9f08-ddd5-42a0-9fb2-ac2b02b45bcc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:00 devstack sudo[104138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:00 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:00 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Deleted volume successfully.
Nov 05 03:56:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e1634f1c-c28d-4197-9708-c3e338645af9 tempest-TestServerVolumeAttachScenarioOldVersion-1260540390 None] Lock "cinder-c964fcc6-75df-4c70-a0e7-ec285f2ea1fc-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:08 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:08 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:09 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.419s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:56:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:56:10 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=49,cinder:INSERT=15,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:10 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=58,cinder:SELECT=46,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Flow 'volume_create_manager' (78fbbca2-dcef-4f08-8098-65733820081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ac4774-ab58-4ce3-a40c-d81f7fcb938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ac4774-ab58-4ce3-a40c-d81f7fcb938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1085777370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22b75d0-079d-405a-a03c-b49336285122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05b3bef550c46e69258e5b876e51545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:15Z,use_quota=True,user_id='de6b10aadb394139bf1d828118220d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62550a49-be7c-414a-81aa-0bf1cff3bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62550a49-be7c-414a-81aa-0bf1cff3bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ae055f-3118-472e-a612-0346f9054885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ae055f-3118-472e-a612-0346f9054885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22b75d0-079d-405a-a03c-b49336285122', 'volume_name': 'volume-c22b75d0-079d-405a-a03c-b49336285122', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb183684-6a61-4ef2-b556-6e27eae7c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb183684-6a61-4ef2-b556-6e27eae7c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52ca2da-e792-4942-825e-0ec47561ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Volume c22b75d0-079d-405a-a03c-b49336285122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22b75d0-079d-405a-a03c-b49336285122', 'volume_size': 1}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1085777370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22b75d0-079d-405a-a03c-b49336285122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05b3bef550c46e69258e5b876e51545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:15Z,use_quota=True,user_id='de6b10aadb394139bf1d828118220d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Creating volume c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:15 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 1073741824
Nov 05 03:56:15 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:16 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 1073741824" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:16 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122
Nov 05 03:56:16 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:16 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52ca2da-e792-4942-825e-0ec47561ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22b75d0-079d-405a-a03c-b49336285122', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35d73b9-48da-4119-86f6-43f48643cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Volume volume-c22b75d0-079d-405a-a03c-b49336285122 (c22b75d0-079d-405a-a03c-b49336285122): created successfully
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35d73b9-48da-4119-86f6-43f48643cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Flow 'volume_create_manager' (78fbbca2-dcef-4f08-8098-65733820081a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-abc8adb1-2af3-472c-aa44-993542aff594 tempest-VolumesCloneTest-1363149766 None] Created volume successfully.
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Flow 'volume_create_manager' (81380dde-2a22-4d55-906f-32946f62e215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91e6c56-57b1-4791-869c-b4417babcc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91e6c56-57b1-4791-869c-b4417babcc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-782395199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564f1c17-9363-44bb-b989-15ee3e55d3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05b3bef550c46e69258e5b876e51545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c22b75d0-079d-405a-a03c-b49336285122,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:18Z,use_quota=True,user_id='de6b10aadb394139bf1d828118220d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789c9178-dfe0-449c-8bed-583c75c7a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789c9178-dfe0-449c-8bed-583c75c7a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5e1f46-1a75-4173-be2e-182d9953b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5e1f46-1a75-4173-be2e-182d9953b562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '564f1c17-9363-44bb-b989-15ee3e55d3fe', 'volume_name': 'volume-564f1c17-9363-44bb-b989-15ee3e55d3fe', 'volume_size': 2, 'source_volid': 'c22b75d0-079d-405a-a03c-b49336285122', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09812b4b-8c9d-45fb-bf70-2efdae87fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09812b4b-8c9d-45fb-bf70-2efdae87fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f53380-9a44-4787-b852-efb396276159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Volume 564f1c17-9363-44bb-b989-15ee3e55d3fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-564f1c17-9363-44bb-b989-15ee3e55d3fe', 'volume_size': 2, 'source_volid': 'c22b75d0-079d-405a-a03c-b49336285122', 'source_volstatus': 'available'}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:18 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Cloning volume c22b75d0-079d-405a-a03c-b49336285122 to volume 564f1c17-9363-44bb-b989-15ee3e55d3fe
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Creating offline snapshot 2b1d6251-fd21-496e-b89e-694bdf17b8d1 of volume c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2e4497-3464-47e4-8e8d-7af108d8a527]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:18 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122
Nov 05 03:56:18 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:19 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122" returned: 0 in 0.553s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:19 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 1G
Nov 05 03:56:19 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:19 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 1G" returned: 0 in 0.597s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c22b75d0-079d-405a-a03c-b49336285122 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:19 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c22b75d0-079d-405a-a03c-b49336285122 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1
Nov 05 03:56:19 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:20 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c22b75d0-079d-405a-a03c-b49336285122 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 is being set with open permissions: ugo+rw
Nov 05 03:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:20 devstack sudo[104205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1
Nov 05 03:56:20 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:20 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:20 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info
Nov 05 03:56:20 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:20 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info is being set with open permissions: ugo+rw
Nov 05 03:56:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:20 devstack sudo[104211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info
Nov 05 03:56:20 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:21 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.info" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Acquiring lock "cinder-quobyte-564f1c17-9363-44bb-b989-15ee3e55d3fe" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-564f1c17-9363-44bb-b989-15ee3e55d3fe" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] snapshot: 2b1d6251-fd21-496e-b89e-694bdf17b8d1, volume: 564f1c17-9363-44bb-b989-15ee3e55d3fe,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ad9aa-7220-42a0-9c43-5510ef5f9a05]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:21 devstack sudo[104214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1
Nov 05 03:56:21 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:21 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1" returned: 0 in 0.579s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c22b75d0-079d-405a-a03c-b49336285122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c8ca4-8cad-4b75-8159-235da7bc0b90]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:22 devstack sudo[104219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122
Nov 05 03:56:22 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:22 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122" returned: 0 in 0.503s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:56:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:56:22 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:56:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:22 devstack sudo[104224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe
Nov 05 03:56:22 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:30 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:30 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:56:31 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe" returned: 0 in 9.111s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:31 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122, size 1024.00 MB, duration 9.11 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:56:31 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Converted 1024.00 MB image at 112.38 MB/s
Nov 05 03:56:31 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe is being set with open permissions: ugo+rw
Nov 05 03:56:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:31 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe
Nov 05 03:56:31 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:31 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-564f1c17-9363-44bb-b989-15ee3e55d3fe" released by "_copy_volume_from_snapshot" :: held 10.680s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Acquiring lock "cinder-quobyte-2b1d6251-fd21-496e-b89e-694bdf17b8d1" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-2b1d6251-fd21-496e-b89e-694bdf17b8d1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Deleting offline snapshot 2b1d6251-fd21-496e-b89e-694bdf17b8d1 of volume c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] snapshot_file for this snap is: volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c5af30-6468-431c-993c-11ca2a399a10]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:32 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1
Nov 05 03:56:32 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:32 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1" returned: 0 in 0.498s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c22b75d0-079d-405a-a03c-b49336285122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb5930d-2368-4145-a62e-eccf20e7f5fd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:32 devstack sudo[104253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122
Nov 05 03:56:32 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:33 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122" returned: 0 in 0.735s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:33 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1
Nov 05 03:56:33 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:33 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1" returned: 0 in 0.532s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:33 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1
Nov 05 03:56:33 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:34 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122.2b1d6251-fd21-496e-b89e-694bdf17b8d1" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-2b1d6251-fd21-496e-b89e-694bdf17b8d1" released by "_delete_snapshot" :: held 2.445s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.039s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f53380-9a44-4787-b852-efb396276159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564f1c17-9363-44bb-b989-15ee3e55d3fe', 'volume_size': 2, 'source_volid': 'c22b75d0-079d-405a-a03c-b49336285122', 'source_volstatus': 'available'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32118ecd-b7c7-4f8c-a691-da212848a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Volume volume-564f1c17-9363-44bb-b989-15ee3e55d3fe (564f1c17-9363-44bb-b989-15ee3e55d3fe): created successfully
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32118ecd-b7c7-4f8c-a691-da212848a500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Flow 'volume_create_manager' (81380dde-2a22-4d55-906f-32946f62e215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-13e64ec4-a641-4e1c-93e5-91b5f0ed9ad8 tempest-VolumesCloneTest-1363149766 None] Created volume successfully.
Nov 05 03:56:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Acquiring lock "cinder-564f1c17-9363-44bb-b989-15ee3e55d3fe-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Lock "cinder-564f1c17-9363-44bb-b989-15ee3e55d3fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Acquiring lock "cinder-quobyte-564f1c17-9363-44bb-b989-15ee3e55d3fe" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-564f1c17-9363-44bb-b989-15ee3e55d3fe" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d8dce-6b1f-4f70-b236-32b1cfec1606]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:36 devstack sudo[104280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe
Nov 05 03:56:36 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (8a9051a0-b711-4c4e-9fcc-bd11c3407529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e58565-2e82-411b-9b99-b31e894eb811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e58565-2e82-411b-9b99-b31e894eb811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-252214992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1660588a-a2df-4c95-b1ba-f2c95365ddc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:36Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd22445-7459-4348-8469-e968add8b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd22445-7459-4348-8469-e968add8b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddd239b-9c22-4f87-b269-a0f4aad3aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ddd239b-9c22-4f87-b269-a0f4aad3aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1660588a-a2df-4c95-b1ba-f2c95365ddc9', 'volume_name': 'volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc1407f-d850-4641-b41c-8390d521176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc1407f-d850-4641-b41c-8390d521176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdddd74-1010-4974-97d2-2f09e9a99b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:36 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume 1660588a-a2df-4c95-b1ba-f2c95365ddc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9', 'volume_size': 1}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-252214992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1660588a-a2df-4c95-b1ba-f2c95365ddc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:36Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating volume 1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:36 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 1073741824
Nov 05 03:56:36 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:36 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe" returned: 0 in 0.581s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:36 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe
Nov 05 03:56:36 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:37 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-564f1c17-9363-44bb-b989-15ee3e55d3fe" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-564f1c17-9363-44bb-b989-15ee3e55d3fe" released by "delete_volume" :: held 1.080s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Created reservations ['23b42942-2cea-45f7-bee1-2682631b462a', '1165f1fd-92c7-43fe-a46c-e08d99724ab6', '1db7d383-035a-45b9-a543-c59abab1ca32', '68406a62-4964-4ece-9e29-77042c7ec8dc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:37 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 1073741824" returned: 0 in 0.777s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:37 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9
Nov 05 03:56:37 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:37 devstack sudo[104316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:37 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:37 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdddd74-1010-4974-97d2-2f09e9a99b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4407fbb4-f4eb-4250-a1ed-5cd5284d6849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 (1660588a-a2df-4c95-b1ba-f2c95365ddc9): created successfully
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4407fbb4-f4eb-4250-a1ed-5cd5284d6849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (8a9051a0-b711-4c4e-9fcc-bd11c3407529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9b9710b2-57b4-46dd-b14a-2453634e300d tempest-CreateVolumesFromSnapshotTest-246549325 None] Created volume successfully.
Nov 05 03:56:37 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Deleted volume successfully.
Nov 05 03:56:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c5334111-63fa-4238-bdf9-f3b814d962ee tempest-VolumesCloneTest-1363149766 None] Lock "cinder-564f1c17-9363-44bb-b989-15ee3e55d3fe-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Acquiring lock "cinder-c22b75d0-079d-405a-a03c-b49336285122-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Lock "cinder-c22b75d0-079d-405a-a03c-b49336285122-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Acquiring lock "cinder-quobyte-c22b75d0-079d-405a-a03c-b49336285122" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-c22b75d0-079d-405a-a03c-b49336285122" acquired by "delete_volume" :: waited 0.053s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c6bd2-28ba-4741-9ae9-05a21d462d74]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating offline snapshot 6436d245-01e1-498d-a0f2-adb5bd96314e of volume 1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a71ea3-9226-4c27-a36e-5c1627aecf63]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:39 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122
Nov 05 03:56:39 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:39 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9
Nov 05 03:56:39 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:39 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122" returned: 0 in 0.662s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:39 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9" returned: 0 in 0.516s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:39 devstack sudo[104398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122
Nov 05 03:56:39 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:39 devstack sudo[104399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e 1G
Nov 05 03:56:39 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:39 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c22b75d0-079d-405a-a03c-b49336285122" returned: 0 in 0.514s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Lock "cinder-quobyte-c22b75d0-079d-405a-a03c-b49336285122" released by "delete_volume" :: held 1.377s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Created reservations ['7cc8bf85-5820-4ee9-90d0-9240d90f475a', 'ae664bc8-991a-4eef-afc6-83419a858935', '65010ad9-b597-46e1-a7e2-a99e7a5846e8', '45c464d4-59a1-4c9c-bbfc-5edb20102013'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:40 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e 1G" returned: 0 in 0.793s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:40 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:40 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:40 devstack sudo[104410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e
Nov 05 03:56:40 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:40 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Deleted volume successfully.
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-503873c7-dbb6-4b42-8106-79bf7b8aa8ca tempest-VolumesCloneTest-1363149766 None] Lock "cinder-c22b75d0-079d-405a-a03c-b49336285122-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:40 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:40 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e is being set with open permissions: ugo+rw
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:40 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e
Nov 05 03:56:40 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:40 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:41 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info
Nov 05 03:56:41 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:41 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:41 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info is being set with open permissions: ugo+rw
Nov 05 03:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:41 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info
Nov 05 03:56:41 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:41 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.info" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6b27f93e-4263-479e-b25d-58c1edd2b817 tempest-CreateVolumesFromSnapshotTest-246549325 None] Create snapshot completed successfully
Nov 05 03:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (a14b5e02-0c2a-40b4-97e7-6f3f8e8935b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28544423-0d48-43a4-8f7e-8d146ed57fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28544423-0d48-43a4-8f7e-8d146ed57fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1412240139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8573e81c-51b9-4a96-8406-b9893d778610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:43Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47b54f3-cdad-4b1c-90ae-818b452d6a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47b54f3-cdad-4b1c-90ae-818b452d6a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f44fca8-49d0-45cc-8435-e6557f4419eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f44fca8-49d0-45cc-8435-e6557f4419eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8573e81c-51b9-4a96-8406-b9893d778610', 'volume_name': 'volume-8573e81c-51b9-4a96-8406-b9893d778610', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982c441a-dd09-4b0f-80aa-aeb4d009c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982c441a-dd09-4b0f-80aa-aeb4d009c37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63b4a86-095f-4964-8817-a067fe993d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume 8573e81c-51b9-4a96-8406-b9893d778610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8573e81c-51b9-4a96-8406-b9893d778610', 'volume_size': 1}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1412240139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8573e81c-51b9-4a96-8406-b9893d778610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:43Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating volume 8573e81c-51b9-4a96-8406-b9893d778610 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:43 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610 1073741824
Nov 05 03:56:43 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (bdb57252-dc7a-4d58-96d6-bbe9e1c9088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88fb5198-8860-4041-abeb-7758f56fdf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88fb5198-8860-4041-abeb-7758f56fdf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314705189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398352da-743b-4c3e-ba9b-4eb92888599b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:44Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93feb62-87e4-4031-a991-4e373e1d6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93feb62-87e4-4031-a991-4e373e1d6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:44 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1c3358-38a5-48d2-b3cb-030e549b9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1c3358-38a5-48d2-b3cb-030e549b9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398352da-743b-4c3e-ba9b-4eb92888599b', 'volume_name': 'volume-398352da-743b-4c3e-ba9b-4eb92888599b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2254bed-514b-4c3f-8426-eeead397ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2254bed-514b-4c3f-8426-eeead397ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfed16-29b9-4d4f-907b-95f0a7a8961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume 398352da-743b-4c3e-ba9b-4eb92888599b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398352da-743b-4c3e-ba9b-4eb92888599b', 'volume_size': 1}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610 1073741824" returned: 0 in 1.042s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:44 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610
Nov 05 03:56:44 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:44 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314705189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398352da-743b-4c3e-ba9b-4eb92888599b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:44Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating volume 398352da-743b-4c3e-ba9b-4eb92888599b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:44 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:44 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b 1073741824
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63b4a86-095f-4964-8817-a067fe993d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8573e81c-51b9-4a96-8406-b9893d778610', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:44 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f6a6ab-302d-4070-a392-9894c3e19638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume volume-8573e81c-51b9-4a96-8406-b9893d778610 (8573e81c-51b9-4a96-8406-b9893d778610): created successfully
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f6a6ab-302d-4070-a392-9894c3e19638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (a14b5e02-0c2a-40b4-97e7-6f3f8e8935b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a7c00057-0061-486e-8299-302730132439 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created volume successfully.
Nov 05 03:56:44 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (f1008faf-01df-4cab-8569-2eea548f4da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dfb309-8aea-4fdc-83c7-655302c338cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dfb309-8aea-4fdc-83c7-655302c338cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111425125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738c427a-9d56-4645-bdeb-61fab2654fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:45Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577aa766-4056-4543-a9a2-dba709204e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577aa766-4056-4543-a9a2-dba709204e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6d964a-87e3-48ad-9e85-b866faaac451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6d964a-87e3-48ad-9e85-b866faaac451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738c427a-9d56-4645-bdeb-61fab2654fd9', 'volume_name': 'volume-738c427a-9d56-4645-bdeb-61fab2654fd9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd3d8c8-832f-47d7-8e98-d6762d9996f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd3d8c8-832f-47d7-8e98-d6762d9996f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49320b1b-800d-4173-979e-ebb981620575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume 738c427a-9d56-4645-bdeb-61fab2654fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738c427a-9d56-4645-bdeb-61fab2654fd9', 'volume_size': 1}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Flow 'volume_create_manager' (c0a3c4df-c38d-4bdb-907f-91355b37d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcef05e4-62a6-4fba-92c9-88963536d896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcef05e4-62a6-4fba-92c9-88963536d896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-506522127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8995d7f9-57aa-4643-9292-41652806a358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe6522a756a4dcbaa08cc770ade6cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:45Z,use_quota=True,user_id='c239513a38494a52bc1c7fbe6f883046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b186dc15-4069-44b3-98c1-b88fa090aa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b186dc15-4069-44b3-98c1-b88fa090aa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc17635-5c28-471e-97f9-36d7eda91b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc17635-5c28-471e-97f9-36d7eda91b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8995d7f9-57aa-4643-9292-41652806a358', 'volume_name': 'volume-8995d7f9-57aa-4643-9292-41652806a358', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cafd6ed-4940-4bfc-ba1b-3c602a49e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cafd6ed-4940-4bfc-ba1b-3c602a49e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb33ab6-6ae4-4877-8c53-2f85984c35a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Volume 8995d7f9-57aa-4643-9292-41652806a358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8995d7f9-57aa-4643-9292-41652806a358', 'volume_size': 1}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b 1073741824" returned: 0 in 1.118s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (3b3511f0-897f-4b2b-9cc5-1c66f12f8c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853d5081-8101-4af7-ac07-482e2b852edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853d5081-8101-4af7-ac07-482e2b852edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140458617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0524895e-aac9-45fa-945a-d22764247bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:46Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d3818-143b-4121-b8cc-2da0189258fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d3818-143b-4121-b8cc-2da0189258fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12122c8-148f-4c07-a2b3-a6b24eae2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12122c8-148f-4c07-a2b3-a6b24eae2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0524895e-aac9-45fa-945a-d22764247bb8', 'volume_name': 'volume-0524895e-aac9-45fa-945a-d22764247bb8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44a1340-5cdf-45ca-93f6-68a5bb4a4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44a1340-5cdf-45ca-93f6-68a5bb4a4736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91791b2-d34f-427b-b6ae-77b62586f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume 0524895e-aac9-45fa-945a-d22764247bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0524895e-aac9-45fa-945a-d22764247bb8', 'volume_size': 1}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:46 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b
Nov 05 03:56:46 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (8455e3e8-c8c9-4e0d-8140-514d6e237132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce98e36c-c346-4647-8470-c94012068731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce98e36c-c346-4647-8470-c94012068731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735360271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfea645-7efd-47c7-94ad-eb134eb76ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:46Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7704b65b-6aad-4557-b59f-45555cefdfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7704b65b-6aad-4557-b59f-45555cefdfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced5a08d-e202-4ac0-9d01-c0989f1d81d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced5a08d-e202-4ac0-9d01-c0989f1d81d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfea645-7efd-47c7-94ad-eb134eb76ba1', 'volume_name': 'volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423d5a66-b3fb-45e3-97e9-690e6a3279ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423d5a66-b3fb-45e3-97e9-690e6a3279ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9baf55e-8be4-4603-8b26-c07c969d0b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume 8dfea645-7efd-47c7-94ad-eb134eb76ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1', 'volume_size': 1}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:46 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111425125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738c427a-9d56-4645-bdeb-61fab2654fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:45Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating volume 738c427a-9d56-4645-bdeb-61fab2654fd9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:46 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfed16-29b9-4d4f-907b-95f0a7a8961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398352da-743b-4c3e-ba9b-4eb92888599b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665516ce-ca1d-415f-81fd-64aa6153c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:46 devstack sudo[104446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9 1073741824
Nov 05 03:56:46 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume volume-398352da-743b-4c3e-ba9b-4eb92888599b (398352da-743b-4c3e-ba9b-4eb92888599b): created successfully
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665516ce-ca1d-415f-81fd-64aa6153c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (bdb57252-dc7a-4d58-96d6-bbe9e1c9088a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8bea0794-c32e-49a0-b077-9d66a02d4539 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created volume successfully.
Nov 05 03:56:47 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9 1073741824" returned: 0 in 0.694s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:47 devstack sudo[104452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9
Nov 05 03:56:47 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:47 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.637s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-506522127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8995d7f9-57aa-4643-9292-41652806a358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe6522a756a4dcbaa08cc770ade6cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:45Z,use_quota=True,user_id='c239513a38494a52bc1c7fbe6f883046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Creating volume 8995d7f9-57aa-4643-9292-41652806a358 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:47 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49320b1b-800d-4173-979e-ebb981620575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738c427a-9d56-4645-bdeb-61fab2654fd9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe93766-f521-4f62-be54-0f2d44f3801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:47 devstack sudo[104456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358 1073741824
Nov 05 03:56:47 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume volume-738c427a-9d56-4645-bdeb-61fab2654fd9 (738c427a-9d56-4645-bdeb-61fab2654fd9): created successfully
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe93766-f521-4f62-be54-0f2d44f3801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (f1008faf-01df-4cab-8569-2eea548f4da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5896ff58-0fb6-45bc-8dcf-715f17a4c6bb tempest-CreateVolumesFromSnapshotTest-246549325 None] Created volume successfully.
Nov 05 03:56:48 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358 1073741824" returned: 0 in 0.644s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:48 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358
Nov 05 03:56:48 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:48 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1140458617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0524895e-aac9-45fa-945a-d22764247bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:46Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating volume 0524895e-aac9-45fa-945a-d22764247bb8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:48 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb33ab6-6ae4-4877-8c53-2f85984c35a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8995d7f9-57aa-4643-9292-41652806a358', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcef0b9-4833-4c55-b8f1-0e1bac79d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:48 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8 1073741824
Nov 05 03:56:48 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Volume volume-8995d7f9-57aa-4643-9292-41652806a358 (8995d7f9-57aa-4643-9292-41652806a358): created successfully
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcef0b9-4833-4c55-b8f1-0e1bac79d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Flow 'volume_create_manager' (c0a3c4df-c38d-4bdb-907f-91355b37d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-68d9b679-7969-4899-9c6a-752feee2418e tempest-TestMinimumBasicScenario-1415875348 None] Created volume successfully.
Nov 05 03:56:49 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8 1073741824" returned: 0 in 0.805s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:49 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8
Nov 05 03:56:49 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:50 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8" returned: 0 in 0.539s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.803s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735360271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfea645-7efd-47c7-94ad-eb134eb76ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14b3b1bd2124333a3cc7bfe41de7717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:46Z,use_quota=True,user_id='d0f094299002498d8e5708fffc4814f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Creating volume 8dfea645-7efd-47c7-94ad-eb134eb76ba1 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:56:50 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:50 devstack sudo[104485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 1073741824
Nov 05 03:56:50 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91791b2-d34f-427b-b6ae-77b62586f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0524895e-aac9-45fa-945a-d22764247bb8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccd9d21-bd38-4769-84e5-a1f21d0c0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume volume-0524895e-aac9-45fa-945a-d22764247bb8 (0524895e-aac9-45fa-945a-d22764247bb8): created successfully
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccd9d21-bd38-4769-84e5-a1f21d0c0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (3b3511f0-897f-4b2b-9cc5-1c66f12f8c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-25f3fc4c-b5b5-4cf9-9f4a-db171349a22c tempest-CreateVolumesFromSnapshotTest-246549325 None] Created volume successfully.
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-559682f0-b829-4d11-914a-e3209ce713a8 req-cc9ac739-8abc-49eb-b88c-d1e0b090362f tempest-TestMinimumBasicScenario-1415875348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:50 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 1073741824" returned: 0 in 0.655s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:50 devstack sudo[104490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1
Nov 05 03:56:50 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:51 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-559682f0-b829-4d11-914a-e3209ce713a8 req-cc9ac739-8abc-49eb-b88c-d1e0b090362f tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.868s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9baf55e-8be4-4603-8b26-c07c969d0b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df93930-3bd2-4592-9e52-2d0570b1424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-559682f0-b829-4d11-914a-e3209ce713a8 req-cc9ac739-8abc-49eb-b88c-d1e0b090362f tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:51 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Volume volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 (8dfea645-7efd-47c7-94ad-eb134eb76ba1): created successfully
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df93930-3bd2-4592-9e52-2d0570b1424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Flow 'volume_create_manager' (8455e3e8-c8c9-4e0d-8140-514d6e237132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:56:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-383770ab-7db8-4878-a567-ade016e78da7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created volume successfully.
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-559682f0-b829-4d11-914a-e3209ce713a8 req-cc9ac739-8abc-49eb-b88c-d1e0b090362f tempest-TestMinimumBasicScenario-1415875348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-8995d7f9-57aa-4643-9292-41652806a358', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2762e4ca-424d-4fd4-8b90-28cb2c416800', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:56:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-559682f0-b829-4d11-914a-e3209ce713a8 req-cc9ac739-8abc-49eb-b88c-d1e0b090362f tempest-TestMinimumBasicScenario-1415875348 None] attachment_update completed successfully.
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-8dfea645-7efd-47c7-94ad-eb134eb76ba1-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-8dfea645-7efd-47c7-94ad-eb134eb76ba1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-8dfea645-7efd-47c7-94ad-eb134eb76ba1" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-8dfea645-7efd-47c7-94ad-eb134eb76ba1" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5f4b7b-068a-49f2-b382-c2c7a4e32cbe]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:52 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1
Nov 05 03:56:52 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:52 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1" returned: 0 in 0.566s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:52 devstack sudo[104914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1
Nov 05 03:56:52 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:53 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dfea645-7efd-47c7-94ad-eb134eb76ba1" returned: 0 in 0.628s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-8dfea645-7efd-47c7-94ad-eb134eb76ba1" released by "delete_volume" :: held 1.290s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['76d00ac3-7b83-4e13-9ab4-f0b26076f739', '613467b3-1a78-45c8-ba58-077fcc65bd6a', 'a263c7c0-54ae-421f-8fe3-cd71cdd5846e', '1264301a-a923-448d-9f37-ef380cb821d3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:53 devstack sudo[104963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:53 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:53 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:53 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleted volume successfully.
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f022de96-0b74-44c4-ba48-00f33379fa71 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-8dfea645-7efd-47c7-94ad-eb134eb76ba1-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-0524895e-aac9-45fa-945a-d22764247bb8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-0524895e-aac9-45fa-945a-d22764247bb8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-0524895e-aac9-45fa-945a-d22764247bb8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-0524895e-aac9-45fa-945a-d22764247bb8" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[43170bf6-3800-4ba0-9cc4-7e6ca3c38907]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:54 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8
Nov 05 03:56:54 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:54 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8" returned: 0 in 0.526s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:54 devstack sudo[104972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8
Nov 05 03:56:54 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:55 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0524895e-aac9-45fa-945a-d22764247bb8" returned: 0 in 0.293s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-0524895e-aac9-45fa-945a-d22764247bb8" released by "delete_volume" :: held 0.892s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['1a7f29fa-20ff-4ca5-9a59-4fa267677967', 'e8dc88a4-4f4c-495b-a69a-8956056a740e', '97d5ebed-0539-4a61-899b-00f9c3d6b136', '5a2154e7-cc6d-49f7-b6fd-52d354a4f9c0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-738c427a-9d56-4645-bdeb-61fab2654fd9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:55 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:55 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-738c427a-9d56-4645-bdeb-61fab2654fd9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-738c427a-9d56-4645-bdeb-61fab2654fd9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-738c427a-9d56-4645-bdeb-61fab2654fd9" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa4bc3-bc52-4a7d-8333-a88fccda6bf6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:55 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleted volume successfully.
Nov 05 03:56:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-656964fb-34a7-4ae1-a20c-032c5abdd696 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-0524895e-aac9-45fa-945a-d22764247bb8-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:55 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9
Nov 05 03:56:55 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:56 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9" returned: 0 in 0.520s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:56 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9
Nov 05 03:56:56 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:56 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-738c427a-9d56-4645-bdeb-61fab2654fd9" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-738c427a-9d56-4645-bdeb-61fab2654fd9" released by "delete_volume" :: held 0.929s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['dd0cae5c-b472-424d-8d01-db72e41223d6', '918db7b5-03a6-414c-97e1-e8026a662ffa', '1fe94d14-5754-4c91-902a-f92fe87e4249', '698a11c9-f4fb-47d9-a6bb-d48ac01e3d1f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:56 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:56 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:57 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:57 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleted volume successfully.
Nov 05 03:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7b4a55b2-80a9-4528-a286-dd5ac14a98e0 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-738c427a-9d56-4645-bdeb-61fab2654fd9-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-398352da-743b-4c3e-ba9b-4eb92888599b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-398352da-743b-4c3e-ba9b-4eb92888599b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-398352da-743b-4c3e-ba9b-4eb92888599b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:56:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-398352da-743b-4c3e-ba9b-4eb92888599b" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:56:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0644d51-e3da-4752-8f0f-26bcaf5c9618]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:58 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b
Nov 05 03:56:58 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:58 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b" returned: 0 in 0.548s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:58 devstack sudo[105034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b
Nov 05 03:56:58 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:59 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-398352da-743b-4c3e-ba9b-4eb92888599b" returned: 0 in 0.340s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-398352da-743b-4c3e-ba9b-4eb92888599b" released by "delete_volume" :: held 1.009s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['64019c53-1a74-4050-bece-4fc620990eec', 'cebf7096-2f4e-4816-86ad-29407c44953d', '3a28bfe5-02d7-4f68-81fe-035b5da6a38a', '0c72cde0-8061-4ab4-926f-85af52848378'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:56:59 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:56:59 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:56:59 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:56:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleted volume successfully.
Nov 05 03:56:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f93d7bba-2f65-437d-8040-f06a58ac36f7 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-398352da-743b-4c3e-ba9b-4eb92888599b-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-8573e81c-51b9-4a96-8406-b9893d778610-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-8573e81c-51b9-4a96-8406-b9893d778610-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-8573e81c-51b9-4a96-8406-b9893d778610" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-8573e81c-51b9-4a96-8406-b9893d778610" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:00 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455731a-4801-47fd-9c47-c3775601fee9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:00 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610
Nov 05 03:57:00 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:01 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610" returned: 0 in 0.664s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:01 devstack sudo[105046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610
Nov 05 03:57:01 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:01 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8573e81c-51b9-4a96-8406-b9893d778610" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-8573e81c-51b9-4a96-8406-b9893d778610" released by "delete_volume" :: held 1.122s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['f6e38c4d-b9d9-4ab0-bb24-8cac9e7b2c34', '1e66ee72-1dca-4fed-ac0f-e3d72e04abab', '28f63258-d47f-4a52-b751-bc60164a3a0d', '8bfeded2-77f9-4346-a879-f0c53ed217d3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:01 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:01 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:02 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleted volume successfully.
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d4f823d3-c6d2-4147-bb8f-df5b08b4fdbf tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-8573e81c-51b9-4a96-8406-b9893d778610-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-6436d245-01e1-498d-a0f2-adb5bd96314e-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-6436d245-01e1-498d-a0f2-adb5bd96314e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-1660588a-a2df-4c95-b1ba-f2c95365ddc9" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-1660588a-a2df-4c95-b1ba-f2c95365ddc9" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-6436d245-01e1-498d-a0f2-adb5bd96314e" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-6436d245-01e1-498d-a0f2-adb5bd96314e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleting offline snapshot 6436d245-01e1-498d-a0f2-adb5bd96314e of volume 1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] snapshot_file for this snap is: volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d347a0-eae3-40ab-8d07-14057c44f3bd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:03 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e
Nov 05 03:57:03 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:03 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e" returned: 0 in 0.523s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:57:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086ee5a-1dd7-4280-9e63-ba28ceadd53b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:03 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9
Nov 05 03:57:03 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:04 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9" returned: 0 in 0.686s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:04 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e
Nov 05 03:57:04 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:04 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:04 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e
Nov 05 03:57:04 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:05 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9.6436d245-01e1-498d-a0f2-adb5bd96314e" returned: 0 in 0.379s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-6436d245-01e1-498d-a0f2-adb5bd96314e" released by "_delete_snapshot" :: held 2.236s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-1660588a-a2df-4c95-b1ba-f2c95365ddc9" released by "delete_snapshot" :: held 2.291s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:05 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['ab4d68c4-83cc-4a1a-915c-435a0c3b04e6', '83ab1686-e0fb-4dc1-bfe6-1bd3b1216b20', '864f5ee3-07e0-444e-9f4a-c7568f37d906', '2f8b9cf9-da83-4021-9f3d-beda4ed35954'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Delete snapshot completed successfully.
Nov 05 03:57:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0f1473b1-d65f-4173-96d3-640c816c4af8 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-6436d245-01e1-498d-a0f2-adb5bd96314e-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-1660588a-a2df-4c95-b1ba-f2c95365ddc9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-1660588a-a2df-4c95-b1ba-f2c95365ddc9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "cinder-quobyte-1660588a-a2df-4c95-b1ba-f2c95365ddc9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-1660588a-a2df-4c95-b1ba-f2c95365ddc9" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[87947755-e959-4f55-aa72-ad876570df39]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:06 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9
Nov 05 03:57:06 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:06 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:06 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9
Nov 05 03:57:06 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:07 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1660588a-a2df-4c95-b1ba-f2c95365ddc9" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-quobyte-1660588a-a2df-4c95-b1ba-f2c95365ddc9" released by "delete_volume" :: held 1.007s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Created reservations ['c9be1926-3531-4fca-a214-2b380b3909db', '08b09828-4872-4f49-b07d-4dab4e9f02fe', '15c7edc2-49fd-4714-a727-9f509bb03501', '03f1a20b-9cba-4e9d-9309-a0d0a0ba4705'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:07 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:07 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:07 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:07 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Deleted volume successfully.
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e1588d4-291f-4cfc-9cea-72e1ee065e23 tempest-CreateVolumesFromSnapshotTest-246549325 None] Lock "cinder-1660588a-a2df-4c95-b1ba-f2c95365ddc9-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:08 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:08 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:09 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:57:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (36e9dc10-cf3b-4319-806e-eea4eac1d3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bf3e32-3abc-4c5b-868a-b1c7de701a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bf3e32-3abc-4c5b-868a-b1c7de701a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1016405720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4416877d-ee20-4d94-ac59-7105202773bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:12Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a415bfe9-1681-4c54-876d-6aed0d8d1d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a415bfe9-1681-4c54-876d-6aed0d8d1d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7294723-9ca9-4898-a33f-0d82974de99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7294723-9ca9-4898-a33f-0d82974de99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4416877d-ee20-4d94-ac59-7105202773bd', 'volume_name': 'volume-4416877d-ee20-4d94-ac59-7105202773bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b292c7-d6d6-49e9-a918-13284367e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b292c7-d6d6-49e9-a918-13284367e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a39be0c-9fca-4fe1-9493-dd715df6fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:12 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume 4416877d-ee20-4d94-ac59-7105202773bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4416877d-ee20-4d94-ac59-7105202773bd', 'volume_size': 1}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1016405720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4416877d-ee20-4d94-ac59-7105202773bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:12Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Creating volume 4416877d-ee20-4d94-ac59-7105202773bd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:12 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:12 devstack sudo[105121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd 1073741824
Nov 05 03:57:12 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:12 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd 1073741824" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:12 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd
Nov 05 03:57:12 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:13 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd" returned: 0 in 0.376s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a39be0c-9fca-4fe1-9493-dd715df6fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4416877d-ee20-4d94-ac59-7105202773bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1e4aa-4ac1-45f3-9463-4910883dcd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:13 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume volume-4416877d-ee20-4d94-ac59-7105202773bd (4416877d-ee20-4d94-ac59-7105202773bd): created successfully
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1e4aa-4ac1-45f3-9463-4910883dcd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (36e9dc10-cf3b-4319-806e-eea4eac1d3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-47223993-0bf1-4bfb-8c05-da300caf049c tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created volume successfully.
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (b01f1d22-bb0a-4bb6-bf6a-1f9146157486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d01450b-a3aa-4a6e-82f2-39753d09c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d01450b-a3aa-4a6e-82f2-39753d09c308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870041323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51816e76-5669-4986-a0fb-7fc32c0cb32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:15Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fba816-c3c7-4943-b02e-0b0687dc630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fba816-c3c7-4943-b02e-0b0687dc630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf061e49-bf16-460b-a67c-90b674847888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf061e49-bf16-460b-a67c-90b674847888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51816e76-5669-4986-a0fb-7fc32c0cb32b', 'volume_name': 'volume-51816e76-5669-4986-a0fb-7fc32c0cb32b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded5a4b9-c7ea-4eb6-b897-df491ca96dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded5a4b9-c7ea-4eb6-b897-df491ca96dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a3c2bb-7682-4bda-b758-0e31b82f5551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume 51816e76-5669-4986-a0fb-7fc32c0cb32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51816e76-5669-4986-a0fb-7fc32c0cb32b', 'volume_size': 1}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870041323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51816e76-5669-4986-a0fb-7fc32c0cb32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:15Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Creating volume 51816e76-5669-4986-a0fb-7fc32c0cb32b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:15 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b 1073741824
Nov 05 03:57:15 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (f38242d7-ee41-4f8d-b2c9-f19d8132a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545b82d8-03c8-409e-9650-e57b88d06727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545b82d8-03c8-409e-9650-e57b88d06727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272326745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde65a18-8a63-4b5d-8175-a635f11c03cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:15Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959b0852-d9df-4783-b40d-08f64c52df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959b0852-d9df-4783-b40d-08f64c52df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ac1b14-ca33-4873-983a-02814c468ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ac1b14-ca33-4873-983a-02814c468ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde65a18-8a63-4b5d-8175-a635f11c03cf', 'volume_name': 'volume-dde65a18-8a63-4b5d-8175-a635f11c03cf', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26964ac6-d0fc-4783-bd68-e71cb720b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26964ac6-d0fc-4783-bd68-e71cb720b912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7444297-c48d-4531-8710-0eac052648ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:15 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume dde65a18-8a63-4b5d-8175-a635f11c03cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde65a18-8a63-4b5d-8175-a635f11c03cf', 'volume_size': 1}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:15 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b 1073741824" returned: 0 in 0.680s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:15 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b
Nov 05 03:57:15 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:16 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b" returned: 0 in 0.567s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272326745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde65a18-8a63-4b5d-8175-a635f11c03cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:15Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Creating volume dde65a18-8a63-4b5d-8175-a635f11c03cf {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a3c2bb-7682-4bda-b758-0e31b82f5551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51816e76-5669-4986-a0fb-7fc32c0cb32b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack sudo[105138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf 1073741824
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0453967-4505-4695-b1bf-af39a400dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume volume-51816e76-5669-4986-a0fb-7fc32c0cb32b (51816e76-5669-4986-a0fb-7fc32c0cb32b): created successfully
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0453967-4505-4695-b1bf-af39a400dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (b01f1d22-bb0a-4bb6-bf6a-1f9146157486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-23915a6e-1709-417b-be1e-942f18adc5f7 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created volume successfully.
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (9792546c-fa31-4140-bb27-6580d845bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95759692-494a-4210-b5f1-dde5930206d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95759692-494a-4210-b5f1-dde5930206d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8291477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc74055-480c-4d72-a0cb-eda8bbcaf231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:17Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff3cf24-c093-4dce-80d2-ce265d9dc6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff3cf24-c093-4dce-80d2-ce265d9dc6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da7b86b-50bb-4b91-bc39-322a23f342c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da7b86b-50bb-4b91-bc39-322a23f342c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc74055-480c-4d72-a0cb-eda8bbcaf231', 'volume_name': 'volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a912da-2aa2-42fd-bd6a-95a0ba334c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a912da-2aa2-42fd-bd6a-95a0ba334c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2c6acd-c224-4e63-a2b8-2082c050d995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume 8dc74055-480c-4d72-a0cb-eda8bbcaf231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231', 'volume_size': 1}
Nov 05 03:57:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (d273282a-16f4-45a5-9ce6-a6dd401ebb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d727f321-b00e-48a0-b76a-6d500e0546f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d727f321-b00e-48a0-b76a-6d500e0546f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918578698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00a690b-5323-4644-abbf-badc4a8f72c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:17Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1405d80b-aa5e-4b26-8011-512c0f882e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1405d80b-aa5e-4b26-8011-512c0f882e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4a9f3c-2610-4297-ac43-168cb5fb2983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4a9f3c-2610-4297-ac43-168cb5fb2983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00a690b-5323-4644-abbf-badc4a8f72c8', 'volume_name': 'volume-c00a690b-5323-4644-abbf-badc4a8f72c8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7812d47d-0e34-4abc-9d4c-a8d08e48cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7812d47d-0e34-4abc-9d4c-a8d08e48cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12480fe-b20a-4321-ac9a-329dc8194255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume c00a690b-5323-4644-abbf-badc4a8f72c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00a690b-5323-4644-abbf-badc4a8f72c8', 'volume_size': 1}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:17 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf 1073741824" returned: 0 in 0.793s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:17 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf
Nov 05 03:57:17 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (76afe96c-1969-46ed-a00d-fc369c1d5e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:17 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5b4134-b910-4d4d-9830-f4a0bd683856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8291477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc74055-480c-4d72-a0cb-eda8bbcaf231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:17Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Creating volume 8dc74055-480c-4d72-a0cb-eda8bbcaf231 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:17 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5b4134-b910-4d4d-9830-f4a0bd683856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-134316927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1025e6b4-36b1-418b-9bac-c86255d1f056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:18Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c225c7-917e-485b-98ea-3ba88caaba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 1073741824
Nov 05 03:57:17 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c225c7-917e-485b-98ea-3ba88caaba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df846b9-a0e3-4e24-b092-b56548e3e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df846b9-a0e3-4e24-b092-b56548e3e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1025e6b4-36b1-418b-9bac-c86255d1f056', 'volume_name': 'volume-1025e6b4-36b1-418b-9bac-c86255d1f056', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76ccc5b-6b09-4939-955c-358c5dd9d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76ccc5b-6b09-4939-955c-358c5dd9d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59dd42a-5f58-4636-bf5b-9710607e0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume 1025e6b4-36b1-418b-9bac-c86255d1f056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1025e6b4-36b1-418b-9bac-c86255d1f056', 'volume_size': 1}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7444297-c48d-4531-8710-0eac052648ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde65a18-8a63-4b5d-8175-a635f11c03cf', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029e49c2-7c8b-4b11-bf43-41dfe5beaee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume volume-dde65a18-8a63-4b5d-8175-a635f11c03cf (dde65a18-8a63-4b5d-8175-a635f11c03cf): created successfully
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029e49c2-7c8b-4b11-bf43-41dfe5beaee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (f38242d7-ee41-4f8d-b2c9-f19d8132a25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f87f86a5-a0a6-4c9b-87b0-695a7561a175 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created volume successfully.
Nov 05 03:57:18 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 1073741824" returned: 0 in 0.580s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:18 devstack sudo[105154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231
Nov 05 03:57:18 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:18 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918578698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00a690b-5323-4644-abbf-badc4a8f72c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:17Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Creating volume c00a690b-5323-4644-abbf-badc4a8f72c8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:18 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2c6acd-c224-4e63-a2b8-2082c050d995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:18 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8 1073741824
Nov 05 03:57:18 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f609ba2c-a9e0-43c0-88d7-a551af1c3a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:18 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 (8dc74055-480c-4d72-a0cb-eda8bbcaf231): created successfully
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f609ba2c-a9e0-43c0-88d7-a551af1c3a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (9792546c-fa31-4140-bb27-6580d845bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2f35c697-0c44-4b8d-bc04-d49511c75362 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created volume successfully.
Nov 05 03:57:19 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8 1073741824" returned: 0 in 0.625s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:19 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8
Nov 05 03:57:19 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:19 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.862s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-134316927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1025e6b4-36b1-418b-9bac-c86255d1f056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f679b00d0da441a5a9f2ec2b148973d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:18Z,use_quota=True,user_id='57e8a9229fa04bd582cb5d7025e5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Creating volume 1025e6b4-36b1-418b-9bac-c86255d1f056 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:19 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056 1073741824
Nov 05 03:57:19 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12480fe-b20a-4321-ac9a-329dc8194255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00a690b-5323-4644-abbf-badc4a8f72c8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25f7239-e5d4-41ed-979a-3fc29a8ac80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume volume-c00a690b-5323-4644-abbf-badc4a8f72c8 (c00a690b-5323-4644-abbf-badc4a8f72c8): created successfully
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25f7239-e5d4-41ed-979a-3fc29a8ac80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (d273282a-16f4-45a5-9ce6-a6dd401ebb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6fe32d98-452d-4607-9bdb-7919541e6f57 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created volume successfully.
Nov 05 03:57:20 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056 1073741824" returned: 0 in 0.633s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:20 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056
Nov 05 03:57:20 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:20 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59dd42a-5f58-4636-bf5b-9710607e0dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1025e6b4-36b1-418b-9bac-c86255d1f056', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa3993e-56a0-4efa-afdd-e99b40e4e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Volume volume-1025e6b4-36b1-418b-9bac-c86255d1f056 (1025e6b4-36b1-418b-9bac-c86255d1f056): created successfully
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa3993e-56a0-4efa-afdd-e99b40e4e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Flow 'volume_create_manager' (76afe96c-1969-46ed-a00d-fc369c1d5e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0f8fe904-e5e3-4591-9200-d09db795d236 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created volume successfully.
Nov 05 03:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-1025e6b4-36b1-418b-9bac-c86255d1f056-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-1025e6b4-36b1-418b-9bac-c86255d1f056-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-quobyte-1025e6b4-36b1-418b-9bac-c86255d1f056" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-1025e6b4-36b1-418b-9bac-c86255d1f056" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:21 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf73bd-472e-4541-9878-1600c94879bf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:21 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056
Nov 05 03:57:21 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:22 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056" returned: 0 in 0.734s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:22 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056
Nov 05 03:57:22 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:22 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1025e6b4-36b1-418b-9bac-c86255d1f056" returned: 0 in 0.344s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-1025e6b4-36b1-418b-9bac-c86255d1f056" released by "delete_volume" :: held 1.175s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created reservations ['0fb66ed0-55dd-4355-820b-7eee89c120c6', 'eb6603de-4d98-493b-89bd-b4549559faf7', 'adda5651-f656-462b-b948-38b946a0c1a4', '5cdc7e74-52f7-4fde-905f-fdbf5e71a82f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:22 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:22 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Flow 'volume_create_manager' (99a11995-46d6-4698-85bc-ee9cf5c3469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d584b39-d23e-472c-9155-5ef6b535ab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d584b39-d23e-472c-9155-5ef6b535ab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1824059127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89808e7c-3ded-481c-985c-587aba320705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3cb6ad337c4fd6801ba0dd1a099a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:23Z,use_quota=True,user_id='f963d245a2a441c8a883a8af383a8dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3282b11-d97d-4f24-90e2-1b7b00fc2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3282b11-d97d-4f24-90e2-1b7b00fc2a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ca3310-5fe5-47c5-8ff2-cbc688eff075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ca3310-5fe5-47c5-8ff2-cbc688eff075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89808e7c-3ded-481c-985c-587aba320705', 'volume_name': 'volume-89808e7c-3ded-481c-985c-587aba320705', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262480ee-7157-4dfc-921c-38a02304a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262480ee-7157-4dfc-921c-38a02304a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256afe9d-28c5-402f-8e12-0d946634d12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Volume 89808e7c-3ded-481c-985c-587aba320705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89808e7c-3ded-481c-985c-587aba320705', 'volume_size': 1}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1824059127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89808e7c-3ded-481c-985c-587aba320705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3cb6ad337c4fd6801ba0dd1a099a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:23Z,use_quota=True,user_id='f963d245a2a441c8a883a8af383a8dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Creating volume 89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:57:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:23 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 1073741824
Nov 05 03:57:23 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:23 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.390s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Deleted volume successfully.
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-67c26c36-d634-4799-b382-4bad0562294a tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-1025e6b4-36b1-418b-9bac-c86255d1f056-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-c00a690b-5323-4644-abbf-badc4a8f72c8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-c00a690b-5323-4644-abbf-badc4a8f72c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:23 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 1073741824" returned: 0 in 0.657s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-quobyte-c00a690b-5323-4644-abbf-badc4a8f72c8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-c00a690b-5323-4644-abbf-badc4a8f72c8" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f581dc-2831-4cf4-b109-8020d267a9d0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:24 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705
Nov 05 03:57:24 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:24 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8
Nov 05 03:57:24 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:24 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256afe9d-28c5-402f-8e12-0d946634d12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89808e7c-3ded-481c-985c-587aba320705', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b577e64-b196-4892-994c-ae2093059783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:57:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Volume volume-89808e7c-3ded-481c-985c-587aba320705 (89808e7c-3ded-481c-985c-587aba320705): created successfully
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b577e64-b196-4892-994c-ae2093059783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Flow 'volume_create_manager' (99a11995-46d6-4698-85bc-ee9cf5c3469b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:57:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dc679368-d68f-4bb3-9ffa-a5b57af0e0a5 tempest-TestImageHashVerification-1496483412 None] Created volume successfully.
Nov 05 03:57:24 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:24 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8
Nov 05 03:57:24 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:24 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c00a690b-5323-4644-abbf-badc4a8f72c8" returned: 0 in 0.313s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-c00a690b-5323-4644-abbf-badc4a8f72c8" released by "delete_volume" :: held 0.926s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created reservations ['5946ba1c-f7a5-43a5-9da9-ce1036ec1e5c', 'd24cf553-46a5-4f5c-b609-97b5238f9428', '1827eac2-a3df-48a0-93da-4a8ea21ad7b0', '98e6b5ae-7df1-4c6f-abfa-937493e12a3a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:25 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:25 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:25 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.300s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:25 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Deleted volume successfully.
Nov 05 03:57:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-258d5762-cdef-49fe-935a-b44f8af10ede tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-c00a690b-5323-4644-abbf-badc4a8f72c8-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-8dc74055-480c-4d72-a0cb-eda8bbcaf231-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-8dc74055-480c-4d72-a0cb-eda8bbcaf231-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-quobyte-8dc74055-480c-4d72-a0cb-eda8bbcaf231" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-8dc74055-480c-4d72-a0cb-eda8bbcaf231" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[661f260b-053f-4664-81da-a3f0f0714fc5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:26 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231
Nov 05 03:57:26 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d110cc64-fe83-4cd1-b584-97e0c650593b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:26 devstack sudo[105237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705
Nov 05 03:57:26 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:26 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:26 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231
Nov 05 03:57:26 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:26 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fe0138-0273-40d5-b427-1dcc34e35f9d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:26 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8dc74055-480c-4d72-a0cb-eda8bbcaf231" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:26 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705
Nov 05 03:57:26 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-8dc74055-480c-4d72-a0cb-eda8bbcaf231" released by "delete_volume" :: held 0.828s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created reservations ['d2355bb4-0a77-4631-872d-1adf2c7ddf83', '4bf5615e-1b37-47ce-b72a-3b6036e4ddb8', '1cbf7a2c-81c4-4821-a457-a3f8074e8db2', '97fe9829-f869-4cb9-af2d-70b9b387e73e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:27 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:27 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-dde65a18-8a63-4b5d-8175-a635f11c03cf-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-dde65a18-8a63-4b5d-8175-a635f11c03cf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:27 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705" returned: 0 in 0.527s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 /opt/stack/data/cinder/conversion/89808e7c-3ded-481c-985c-587aba320705.temp_image.af82c940-7396-4ce8-9bcd-692ef10a88b5c135npnr.img {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-quobyte-dde65a18-8a63-4b5d-8175-a635f11c03cf" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:27 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 /opt/stack/data/cinder/conversion/89808e7c-3ded-481c-985c-587aba320705.temp_image.af82c940-7396-4ce8-9bcd-692ef10a88b5c135npnr.img
Nov 05 03:57:27 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-dde65a18-8a63-4b5d-8175-a635f11c03cf" acquired by "delete_volume" :: waited 0.045s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[269d8da9-47bb-4d80-bea0-7afd0dd8147b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:27 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Deleted volume successfully.
Nov 05 03:57:27 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf
Nov 05 03:57:27 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-71d05222-603f-41c0-b1f3-27c465efeefa tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-8dc74055-480c-4d72-a0cb-eda8bbcaf231-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:28 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:28 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf
Nov 05 03:57:28 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:28 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dde65a18-8a63-4b5d-8175-a635f11c03cf" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-dde65a18-8a63-4b5d-8175-a635f11c03cf" released by "delete_volume" :: held 1.360s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created reservations ['e9868577-4e49-440c-acdd-377803ca5615', '05ae65d6-2b11-48f7-a9e1-f022edba6b72', '7b388d62-bc90-4cd6-8f5f-4a79ca3d39c7', 'c025002e-4af8-4361-ba6c-97e3ace70b00'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:29 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:29 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:29 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.538s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Deleted volume successfully.
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca5bd00b-7f40-45fa-948b-c349f06319ed tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-dde65a18-8a63-4b5d-8175-a635f11c03cf-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-51816e76-5669-4986-a0fb-7fc32c0cb32b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-51816e76-5669-4986-a0fb-7fc32c0cb32b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-quobyte-51816e76-5669-4986-a0fb-7fc32c0cb32b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-51816e76-5669-4986-a0fb-7fc32c0cb32b" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7629b30b-7545-417a-8650-6b9247bc012b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:30 devstack sudo[105281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b
Nov 05 03:57:30 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:31 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b" returned: 0 in 0.998s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:31 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b
Nov 05 03:57:31 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:31 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-51816e76-5669-4986-a0fb-7fc32c0cb32b" returned: 0 in 0.783s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-51816e76-5669-4986-a0fb-7fc32c0cb32b" released by "delete_volume" :: held 1.913s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=160,cinder:SELECT=109,cinder:INSERT=31,cinder:DELETE=17 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=142,cinder:SELECT=132,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created reservations ['bff39317-130f-441b-b6e8-00484c175008', '21e8c511-ebb2-483d-bc3f-9d2f96e9d0f7', '1ea5f3d0-3bbb-4339-a64f-6fcb097e3da5', '39634563-6e65-40f6-abe7-d55320ebc192'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:32 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:32 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:33 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.806s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Deleted volume successfully.
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e7969428-bedd-4266-b3d6-6750b662cc86 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-51816e76-5669-4986-a0fb-7fc32c0cb32b-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-4416877d-ee20-4d94-ac59-7105202773bd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-4416877d-ee20-4d94-ac59-7105202773bd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "cinder-quobyte-4416877d-ee20-4d94-ac59-7105202773bd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-4416877d-ee20-4d94-ac59-7105202773bd" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8067d344-f92f-4d21-91df-c7b679513718]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:34 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd
Nov 05 03:57:34 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:35 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd" returned: 0 in 1.050s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:35 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd
Nov 05 03:57:35 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:35 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4416877d-ee20-4d94-ac59-7105202773bd" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-quobyte-4416877d-ee20-4d94-ac59-7105202773bd" released by "delete_volume" :: held 1.687s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Created reservations ['45e76156-84ae-459d-ab4a-77f246ddbe37', '2816f9c3-c748-4322-a77f-46453ef42bf2', '3dc4d884-808f-4d73-bbc8-819b326ea267', '68cd875f-ac91-4ae6-8d13-fa17975a5e76'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:35 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:35 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:36 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.380s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:57:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Deleted volume successfully.
Nov 05 03:57:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-987f380f-9113-4d44-84e8-9022dbbecb46 tempest-CreateVolumesFromSourceVolumeTest-1830605184 None] Lock "cinder-4416877d-ee20-4d94-ac59-7105202773bd-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:36 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 /opt/stack/data/cinder/conversion/89808e7c-3ded-481c-985c-587aba320705.temp_image.af82c940-7396-4ce8-9bcd-692ef10a88b5c135npnr.img" returned: 0 in 9.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e55add-a37c-45ad-8594-7a577d39cb08]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:36 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705
Nov 05 03:57:36 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:37 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705" returned: 0 in 0.603s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:37 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705, size 1024.00 MB, duration 9.32 sec, destination /opt/stack/data/cinder/conversion/89808e7c-3ded-481c-985c-587aba320705.temp_image.af82c940-7396-4ce8-9bcd-692ef10a88b5c135npnr.img {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:57:37 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Converted 1024.00 MB image at 109.88 MB/s
Nov 05 03:57:37 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] af82c940-7396-4ce8-9bcd-692ef10a88b5 was raw, no need to convert to raw {{(pid=87098) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Nov 05 03:57:47 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:57:47 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:INSERT=4,cinder:UPDATE=13,cinder:SELECT=7 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:57:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.315s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Uploaded volume to glance image-id: af82c940-7396-4ce8-9bcd-692ef10a88b5. {{(pid=87098) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}}
Nov 05 03:57:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cfc036a4-9537-4a4c-bf1b-da1f13cedb86 tempest-TestImageHashVerification-1496483412 None] Copy volume to image completed successfully.
Nov 05 03:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Acquiring lock "cinder-89808e7c-3ded-481c-985c-587aba320705-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Lock "cinder-89808e7c-3ded-481c-985c-587aba320705-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Acquiring lock "cinder-quobyte-89808e7c-3ded-481c-985c-587aba320705" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:57:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Lock "cinder-quobyte-89808e7c-3ded-481c-985c-587aba320705" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:57:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8a215-63c4-4b09-9665-dc3afe5d9677]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:57:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:58 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705
Nov 05 03:57:58 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:59 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:59 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705
Nov 05 03:57:59 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:57:59 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-89808e7c-3ded-481c-985c-587aba320705" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Lock "cinder-quobyte-89808e7c-3ded-481c-985c-587aba320705" released by "delete_volume" :: held 0.859s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Created reservations ['94bef08f-86c7-4c9f-8ba3-c5b4b39c453a', 'eedb6b57-d759-4b9c-8825-ad5a6be4aa18', 'a37afac6-6ff6-42ff-9d4c-5f6b5b312695', '3485f39c-a76b-4dd1-b631-4b1450106ac4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:57:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:57:59 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:57:59 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:00 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Deleted volume successfully.
Nov 05 03:58:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8e42a7ba-66d0-4dba-b2f9-d2cd1b814b4e tempest-TestImageHashVerification-1496483412 None] Lock "cinder-89808e7c-3ded-481c-985c-587aba320705-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-c5b290d1-e54d-4777-bcff-38c63d306511 req-4a9d2805-64a8-4e68-a299-2dbc0c8c2476 tempest-TestMinimumBasicScenario-1415875348 None] Terminate volume connection completed successfully.
Nov 05 03:58:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-c5b290d1-e54d-4777-bcff-38c63d306511 req-4a9d2805-64a8-4e68-a299-2dbc0c8c2476 tempest-TestMinimumBasicScenario-1415875348 None] Deleting attachment 2762e4ca-424d-4fd4-8b90-28cb2c416800. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:58:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Acquiring lock "cinder-8995d7f9-57aa-4643-9292-41652806a358-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Lock "cinder-8995d7f9-57aa-4643-9292-41652806a358-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Acquiring lock "cinder-quobyte-8995d7f9-57aa-4643-9292-41652806a358" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Lock "cinder-quobyte-8995d7f9-57aa-4643-9292-41652806a358" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a13ce-b75f-4cab-aeb1-0ecab4415f26]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:02 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358
Nov 05 03:58:02 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:03 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:03 devstack sudo[105391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358
Nov 05 03:58:03 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:03 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8995d7f9-57aa-4643-9292-41652806a358" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Lock "cinder-quobyte-8995d7f9-57aa-4643-9292-41652806a358" released by "delete_volume" :: held 0.815s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Created reservations ['288569e0-4d3d-4950-81cf-5f4fe85c74a9', 'db6d8c7e-9419-4481-b4e0-1f62dbb499a7', 'b1c90e1d-cb1b-457b-8b30-4ade8fad2ab0', 'fc2ddfc0-f8a2-470d-9158-883d60e47533'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:03 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:58:03 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:03 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Deleted volume successfully.
Nov 05 03:58:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ca2d9ab-ab4a-4a2c-98a3-b437264ee329 tempest-TestMinimumBasicScenario-1415875348 None] Lock "cinder-8995d7f9-57aa-4643-9292-41652806a358-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:08 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:58:08 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:09 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:58:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:58:13 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:58:13 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=19,cinder:SELECT=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Flow 'volume_create_manager' (56dc18a2-8044-4c1a-9105-18d6b65f1acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1760ad-c5ef-4fc8-ab6c-a460eba6ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1760ad-c5ef-4fc8-ab6c-a460eba6ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48f5c5d-7634-4996-9183-6b58243fba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4de615c8b624ea1a06c391c81ad6963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:25Z,use_quota=True,user_id='fdbdff2bc9f944c9bf603608f2495da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16f333f5-9815-4210-bc28-458e65d0ea6f),volume_type_id=16f333f5-9815-4210-bc28-458e65d0ea6f)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b1a7d0-c206-426f-8b16-90a0803db225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b1a7d0-c206-426f-8b16-90a0803db225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa1420a-f0df-43da-b0be-39461dea8789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:24 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa1420a-f0df-43da-b0be-39461dea8789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c48f5c5d-7634-4996-9183-6b58243fba22', 'volume_name': 'volume-c48f5c5d-7634-4996-9183-6b58243fba22', 'volume_size': 1, 'image_id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45d0dded-4822-4f40-abdb-942aa6a68827', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45166906f9d35c405e72468a460cccbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4de615c8b624ea1a06c391c81ad6963', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a991235b73a159dbeaf4b8601a786eb3f9348fcf044cc87151655a20c4257286e33a64ca338a8ad7d6ad29affd90197c82d8c3ce3aaeb74a38a0d29235603522', 'id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'created_at': datetime.datetime(2026, 11, 5, 2, 58, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 58, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45d0dded-4822-4f40-abdb-942aa6a68827/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7359b65d0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c305fe-e2ed-4eab-b687-19c2a2ddd4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c305fe-e2ed-4eab-b687-19c2a2ddd4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a718e2cf-00f8-46d1-b3b3-f1575c5cf164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Volume c48f5c5d-7634-4996-9183-6b58243fba22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c48f5c5d-7634-4996-9183-6b58243fba22', 'volume_size': 1, 'image_id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45d0dded-4822-4f40-abdb-942aa6a68827', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45166906f9d35c405e72468a460cccbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4de615c8b624ea1a06c391c81ad6963', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a991235b73a159dbeaf4b8601a786eb3f9348fcf044cc87151655a20c4257286e33a64ca338a8ad7d6ad29affd90197c82d8c3ce3aaeb74a38a0d29235603522', 'id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'created_at': datetime.datetime(2026, 11, 5, 2, 58, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 58, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45d0dded-4822-4f40-abdb-942aa6a68827/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7359b65d0>}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Trying to clone c48f5c5d-7634-4996-9183-6b58243fba22 from image 45d0dded-4822-4f40-abdb-942aa6a68827 at location (None, [{'url': 'file:///opt/stack/data/glance/images/45d0dded-4822-4f40-abdb-942aa6a68827', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 03:58:25 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f9d4ee-3380-401a-a590-13b82e27de95]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:25 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD
Nov 05 03:58:25 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:25 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:25 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD
Nov 05 03:58:25 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:26 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Temporary image 45d0dded-4822-4f40-abdb-942aa6a68827 is fetched for user fdbdff2bc9f944c9bf603608f2495da3. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ace66-8c99-4d3b-be61-d0aee8408154]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:26 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD
Nov 05 03:58:26 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:26 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:26 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD
Nov 05 03:58:26 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:27 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48f5c5d-7634-4996-9183-6b58243fba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4de615c8b624ea1a06c391c81ad6963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:25Z,use_quota=True,user_id='fdbdff2bc9f944c9bf603608f2495da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16f333f5-9815-4210-bc28-458e65d0ea6f),volume_type_id=16f333f5-9815-4210-bc28-458e65d0ea6f)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Creating volume c48f5c5d-7634-4996-9183-6b58243fba22 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:58:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:27 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 1073741824
Nov 05 03:58:27 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:27 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 1073741824" returned: 0 in 0.557s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:27 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22
Nov 05 03:58:27 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:27 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:27 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Attempting download of 45d0dded-4822-4f40-abdb-942aa6a68827 ((None, [{'url': 'file:///opt/stack/data/glance/images/45d0dded-4822-4f40-abdb-942aa6a68827', 'metadata': {}}])) to volume c48f5c5d-7634-4996-9183-6b58243fba22. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ab6d3-8c60-4503-87ba-8eb25072a9bf]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:28 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty
Nov 05 03:58:28 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:28 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:28 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty
Nov 05 03:58:28 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:28 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty" returned: 1 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45d0dded-4822-4f40-abdb-942aa6a68827_hkoqn6ty' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0687d817-3351-4ff6-b731-9200c2ff760b]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:28 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD
Nov 05 03:58:28 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:29 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:29 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD
Nov 05 03:58:29 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:29 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 03:58:29 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] 45d0dded-4822-4f40-abdb-942aa6a68827 was raw, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 03:58:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:29 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22
Nov 05 03:58:29 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:30 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22" returned: 0 in 0.606s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45d0dded-4822-4f40-abdb-942aa6a68827_nke17eiqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:58:30 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:30 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 1G
Nov 05 03:58:30 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:30 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 1G" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Downloaded image 45d0dded-4822-4f40-abdb-942aa6a68827 ((None, [{'url': 'file:///opt/stack/data/glance/images/45d0dded-4822-4f40-abdb-942aa6a68827', 'metadata': {}}])) to volume c48f5c5d-7634-4996-9183-6b58243fba22 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Temporary image 45d0dded-4822-4f40-abdb-942aa6a68827 for user fdbdff2bc9f944c9bf603608f2495da3 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Marking volume c48f5c5d-7634-4996-9183-6b58243fba22 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Copying metadata from image 45d0dded-4822-4f40-abdb-942aa6a68827 to c48f5c5d-7634-4996-9183-6b58243fba22. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Creating volume glance metadata for volume c48f5c5d-7634-4996-9183-6b58243fba22 backed by image 45d0dded-4822-4f40-abdb-942aa6a68827 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '45166906f9d35c405e72468a460cccbe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a718e2cf-00f8-46d1-b3b3-f1575c5cf164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48f5c5d-7634-4996-9183-6b58243fba22', 'volume_size': 1, 'image_id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45d0dded-4822-4f40-abdb-942aa6a68827', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45166906f9d35c405e72468a460cccbe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4de615c8b624ea1a06c391c81ad6963', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a991235b73a159dbeaf4b8601a786eb3f9348fcf044cc87151655a20c4257286e33a64ca338a8ad7d6ad29affd90197c82d8c3ce3aaeb74a38a0d29235603522', 'id': '45d0dded-4822-4f40-abdb-942aa6a68827', 'created_at': datetime.datetime(2026, 11, 5, 2, 58, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 58, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45d0dded-4822-4f40-abdb-942aa6a68827/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b7359b65d0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af99039a-ff0a-48ba-8e68-1a83adbe3682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Volume volume-c48f5c5d-7634-4996-9183-6b58243fba22 (c48f5c5d-7634-4996-9183-6b58243fba22): created successfully
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af99039a-ff0a-48ba-8e68-1a83adbe3682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Flow 'volume_create_manager' (56dc18a2-8044-4c1a-9105-18d6b65f1acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bc380f59-a05d-4da5-8821-3b3c2ea0739a tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Created volume successfully.
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Acquiring lock "cinder-c48f5c5d-7634-4996-9183-6b58243fba22-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "cinder-c48f5c5d-7634-4996-9183-6b58243fba22-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Acquiring lock "cinder-quobyte-c48f5c5d-7634-4996-9183-6b58243fba22" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "cinder-quobyte-c48f5c5d-7634-4996-9183-6b58243fba22" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa21234-a6ad-49d7-9a29-a7f2993d0894]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:31 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22
Nov 05 03:58:31 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:31 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:31 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22
Nov 05 03:58:31 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:32 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-c48f5c5d-7634-4996-9183-6b58243fba22" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "cinder-quobyte-c48f5c5d-7634-4996-9183-6b58243fba22" released by "delete_volume" :: held 0.770s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:32 devstack cinder-volume[87098]: WARNING cinder.quota [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:32 devstack cinder-volume[87098]: WARNING cinder.quota [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Created reservations ['95d8ba19-bb67-4783-91b5-30f710db8528', '1b8f1acd-49a5-416b-9d3e-61fdd1d54a5d', '22608ba4-7088-433c-942f-176b4093b9e4', 'b0dac68d-c541-45fd-8bd8-cfd09bf564ff'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:32 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:58:32 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:32 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Deleted volume successfully.
Nov 05 03:58:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-932bc8e5-87b1-4854-bf2b-ac8b01203967 tempest-VolumeAndVolumeTypeFromImageTest-176159967 None] Lock "cinder-c48f5c5d-7634-4996-9183-6b58243fba22-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Flow 'volume_create_manager' (9d96a5b2-df5d-4999-b61c-9c7b5dfc164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee601d84-9586-4eb1-8bcd-8753a19f68e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee601d84-9586-4eb1-8bcd-8753a19f68e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334032197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e6af8f-f53c-40f4-a682-07e1e272ec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48a90e7953d496485edc56232d74905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:39Z,use_quota=True,user_id='49cf4814243a45f0a71ca64d9ecf9abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e1759a-1cc6-4dbb-b0b3-730f0ee0f72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e1759a-1cc6-4dbb-b0b3-730f0ee0f72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91ba91b-d158-4542-97f1-4e90477a4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91ba91b-d158-4542-97f1-4e90477a4bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e6af8f-f53c-40f4-a682-07e1e272ec26', 'volume_name': 'volume-74e6af8f-f53c-40f4-a682-07e1e272ec26', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca7ca64-3b6e-4fd3-b60d-bd44ca0bf5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca7ca64-3b6e-4fd3-b60d-bd44ca0bf5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc266c50-1b42-4419-938c-357339177e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Volume 74e6af8f-f53c-40f4-a682-07e1e272ec26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e6af8f-f53c-40f4-a682-07e1e272ec26', 'volume_size': 1}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334032197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e6af8f-f53c-40f4-a682-07e1e272ec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48a90e7953d496485edc56232d74905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:39Z,use_quota=True,user_id='49cf4814243a45f0a71ca64d9ecf9abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Creating volume 74e6af8f-f53c-40f4-a682-07e1e272ec26 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:58:38 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:58:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:38 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 1073741824
Nov 05 03:58:38 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:39 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 1073741824" returned: 0 in 0.551s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:39 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26
Nov 05 03:58:39 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:39 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26" returned: 0 in 0.288s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc266c50-1b42-4419-938c-357339177e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e6af8f-f53c-40f4-a682-07e1e272ec26', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6445ed5-a462-4944-8fcb-6bf959c54ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Volume volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 (74e6af8f-f53c-40f4-a682-07e1e272ec26): created successfully
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6445ed5-a462-4944-8fcb-6bf959c54ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Flow 'volume_create_manager' (9d96a5b2-df5d-4999-b61c-9c7b5dfc164c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9debcfbf-aad4-4af0-a05b-639537bc7583 tempest-ProjectReaderTests-338415159 None] Created volume successfully.
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Acquiring lock "cinder-74e6af8f-f53c-40f4-a682-07e1e272ec26-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Lock "cinder-74e6af8f-f53c-40f4-a682-07e1e272ec26-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Acquiring lock "cinder-quobyte-74e6af8f-f53c-40f4-a682-07e1e272ec26" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Lock "cinder-quobyte-74e6af8f-f53c-40f4-a682-07e1e272ec26" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4b6be-ea47-424f-8b2b-2a6863362119]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:41 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26
Nov 05 03:58:41 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:41 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:41 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26
Nov 05 03:58:41 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:42 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-74e6af8f-f53c-40f4-a682-07e1e272ec26" returned: 0 in 0.319s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Lock "cinder-quobyte-74e6af8f-f53c-40f4-a682-07e1e272ec26" released by "delete_volume" :: held 0.794s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Created reservations ['41457ef5-0e33-447b-9ce3-4736bdca89d2', '998739d8-eeae-4580-9032-648a93261358', '353eb4bb-bae5-440f-ac5b-dc322b60ea23', 'ddfa070a-11e8-49ec-9662-7c246fb2bca5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:42 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:58:42 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:42 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Deleted volume successfully.
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-702dfa70-36b5-4b82-84d2-09d7148db108 tempest-ProjectReaderTests-338415159 None] Lock "cinder-74e6af8f-f53c-40f4-a682-07e1e272ec26-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Flow 'volume_create_manager' (b39ea890-b16e-4eb6-aa04-65bc1c776941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984ce955-7483-46f7-a159-682c66e43c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984ce955-7483-46f7-a159-682c66e43c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714103132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade43718-36b6-46e7-9da2-2903c0065405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48a90e7953d496485edc56232d74905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:43Z,use_quota=True,user_id='49cf4814243a45f0a71ca64d9ecf9abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e832948f-7d3d-41cc-8d92-dd2b87149a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e832948f-7d3d-41cc-8d92-dd2b87149a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bb29ab-772f-4105-8d31-45e12f58957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bb29ab-772f-4105-8d31-45e12f58957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade43718-36b6-46e7-9da2-2903c0065405', 'volume_name': 'volume-ade43718-36b6-46e7-9da2-2903c0065405', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59142d78-b7eb-417f-af52-188f30520eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:42 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59142d78-b7eb-417f-af52-188f30520eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcfd9d7-1e8b-4279-b187-d280157f48a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Volume ade43718-36b6-46e7-9da2-2903c0065405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade43718-36b6-46e7-9da2-2903c0065405', 'volume_size': 1}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714103132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade43718-36b6-46e7-9da2-2903c0065405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48a90e7953d496485edc56232d74905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:43Z,use_quota=True,user_id='49cf4814243a45f0a71ca64d9ecf9abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Creating volume ade43718-36b6-46e7-9da2-2903c0065405 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:58:43 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:43 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405 1073741824
Nov 05 03:58:43 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:43 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405 1073741824" returned: 0 in 0.521s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:43 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405
Nov 05 03:58:43 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:43 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcfd9d7-1e8b-4279-b187-d280157f48a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade43718-36b6-46e7-9da2-2903c0065405', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29769304-98ed-48fd-a622-ed6fe75c1e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Volume volume-ade43718-36b6-46e7-9da2-2903c0065405 (ade43718-36b6-46e7-9da2-2903c0065405): created successfully
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29769304-98ed-48fd-a622-ed6fe75c1e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Flow 'volume_create_manager' (b39ea890-b16e-4eb6-aa04-65bc1c776941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-898478b8-69f8-4470-91e0-62631cd2cca6 tempest-ProjectReaderTests-338415159 None] Created volume successfully.
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Flow 'volume_create_manager' (8b741896-1442-45df-a72b-da7b0b7ee435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c440bf7b-9cf1-4cfe-b153-10e05683a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c440bf7b-9cf1-4cfe-b153-10e05683a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2030036987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d502f30e-b109-4b09-bf12-c9fd7f6b0c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be852870c2034a08890c42abffad110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:45Z,use_quota=True,user_id='97f6d7eac4d142d487a0f17f4117b765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6063cd19-d24d-4c86-afb4-5d5626da0f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6063cd19-d24d-4c86-afb4-5d5626da0f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a07768a-3398-4102-a1bf-d7c3734a8086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a07768a-3398-4102-a1bf-d7c3734a8086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd502f30e-b109-4b09-bf12-c9fd7f6b0c9b', 'volume_name': 'volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720b0180-9a87-4556-82a6-87b841bab3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720b0180-9a87-4556-82a6-87b841bab3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5994c9-1abb-47f1-b06c-4f525bd51da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:44 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Volume d502f30e-b109-4b09-bf12-c9fd7f6b0c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b', 'volume_size': 1}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2030036987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d502f30e-b109-4b09-bf12-c9fd7f6b0c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be852870c2034a08890c42abffad110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:45Z,use_quota=True,user_id='97f6d7eac4d142d487a0f17f4117b765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Creating volume d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:58:44 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:58:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:44 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b 1073741824
Nov 05 03:58:44 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Acquiring lock "cinder-ade43718-36b6-46e7-9da2-2903c0065405-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Lock "cinder-ade43718-36b6-46e7-9da2-2903c0065405-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Acquiring lock "cinder-quobyte-ade43718-36b6-46e7-9da2-2903c0065405" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Lock "cinder-quobyte-ade43718-36b6-46e7-9da2-2903c0065405" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a5add2-b238-4152-b7d5-17c43369f16a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:45 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405
Nov 05 03:58:45 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:45 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b 1073741824" returned: 0 in 0.585s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:45 devstack sudo[105550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b
Nov 05 03:58:45 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:45 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:45 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405
Nov 05 03:58:45 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:45 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" returned: 0 in 0.350s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5994c9-1abb-47f1-b06c-4f525bd51da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f3b742-072c-46d9-a7a5-d33ac9ae5150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:58:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Volume volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b (d502f30e-b109-4b09-bf12-c9fd7f6b0c9b): created successfully
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f3b742-072c-46d9-a7a5-d33ac9ae5150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:58:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Flow 'volume_create_manager' (8b741896-1442-45df-a72b-da7b0b7ee435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:58:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-97243c21-f4dc-4701-bb13-8bd7f7e6dac9 tempest-TestStampPattern-895444116 None] Created volume successfully.
Nov 05 03:58:46 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-ade43718-36b6-46e7-9da2-2903c0065405" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Lock "cinder-quobyte-ade43718-36b6-46e7-9da2-2903c0065405" released by "delete_volume" :: held 0.875s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Created reservations ['839c4548-1968-45f7-ac1b-fcfb25a78677', 'b0f7c85c-b9e2-4981-8a72-9485f1e21fc4', 'd23751e6-5b55-44e9-816b-6b38751eb8f2', '02c6354a-70c6-4fa0-bb58-24455e1f5e67'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:58:46 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:58:46 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:58:46 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:58:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Deleted volume successfully.
Nov 05 03:58:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a8b1146e-3ac8-419d-a15a-cd722d5a79c6 tempest-ProjectReaderTests-338415159 None] Lock "cinder-ade43718-36b6-46e7-9da2-2903c0065405-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:58:56 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=37,cinder:SELECT=31,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:58:56 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=33,cinder:UPDATE=38,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:08 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:59:08 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:08 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 03:59:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Flow 'volume_create_manager' (8fb7f3d1-1ffe-4caf-b26b-746cbb1301e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f9d9ab-884c-4d54-b98c-09f366b89c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f9d9ab-884c-4d54-b98c-09f366b89c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-500507657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cee2e4-36d1-4c50-a0b2-c27c3ae875b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249dac1f0cb84a8aa9d48625b745ff58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:17Z,use_quota=True,user_id='beddb5fe7a074c4ba0a0776403614f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565534d2-0b05-46ec-8c3f-8082aa16d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565534d2-0b05-46ec-8c3f-8082aa16d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32469991-b24f-4510-ab7a-b6f03cad9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32469991-b24f-4510-ab7a-b6f03cad9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70cee2e4-36d1-4c50-a0b2-c27c3ae875b8', 'volume_name': 'volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b97400-1a8b-41d1-839b-18875e0bb9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b97400-1a8b-41d1-839b-18875e0bb9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a90b9e-3089-4194-8b17-c3d295b4158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Volume 70cee2e4-36d1-4c50-a0b2-c27c3ae875b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8', 'volume_size': 1}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-500507657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cee2e4-36d1-4c50-a0b2-c27c3ae875b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249dac1f0cb84a8aa9d48625b745ff58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:17Z,use_quota=True,user_id='beddb5fe7a074c4ba0a0776403614f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Creating volume 70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:59:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 03:59:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:16 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 1073741824
Nov 05 03:59:16 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-771370a8-6424-4388-a790-fcc505280bee req-d550e09c-e681-49c0-a1e9-641304ef89aa tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:17 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 1073741824" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:17 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8
Nov 05 03:59:17 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:17 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-771370a8-6424-4388-a790-fcc505280bee req-d550e09c-e681-49c0-a1e9-641304ef89aa tempest-TestStampPattern-895444116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.401s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a90b9e-3089-4194-8b17-c3d295b4158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c051685-797a-4fcf-abfa-93d02f690a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-771370a8-6424-4388-a790-fcc505280bee req-d550e09c-e681-49c0-a1e9-641304ef89aa tempest-TestStampPattern-895444116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Volume volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 (70cee2e4-36d1-4c50-a0b2-c27c3ae875b8): created successfully
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c051685-797a-4fcf-abfa-93d02f690a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Flow 'volume_create_manager' (8fb7f3d1-1ffe-4caf-b26b-746cbb1301e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ed080822-4c03-40d9-a315-73c11e1329e1 tempest-SnapshotDependencyTests-704764046 None] Created volume successfully.
Nov 05 03:59:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-771370a8-6424-4388-a790-fcc505280bee req-d550e09c-e681-49c0-a1e9-641304ef89aa tempest-TestStampPattern-895444116 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12ff7d16-dc75-4cc1-9cf0-067d6fea9940', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 03:59:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-771370a8-6424-4388-a790-fcc505280bee req-d550e09c-e681-49c0-a1e9-641304ef89aa tempest-TestStampPattern-895444116 None] attachment_update completed successfully.
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Creating offline snapshot f2f70450-8948-4758-933a-630c298efc09 of volume 70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[224a8856-84f2-4dc7-b948-58e4c5db3c1e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:19 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8
Nov 05 03:59:19 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:19 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" returned: 0 in 0.410s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:19 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 1G
Nov 05 03:59:19 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:20 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 1G" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:20 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09
Nov 05 03:59:20 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:20 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 is being set with open permissions: ugo+rw
Nov 05 03:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:20 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09
Nov 05 03:59:20 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:20 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:20 devstack sudo[106198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info
Nov 05 03:59:20 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:21 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:21 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info is being set with open permissions: ugo+rw
Nov 05 03:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:21 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info
Nov 05 03:59:21 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:21 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.info" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:21 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2ff55a7f-7205-4fa2-a606-18079576dd2b tempest-SnapshotDependencyTests-704764046 None] Create snapshot completed successfully
Nov 05 03:59:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Flow 'volume_create_manager' (81447089-373c-49ca-8927-5d87bced8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6d00cc-4e2b-4c87-839d-3dc2365c8862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6d00cc-4e2b-4c87-839d-3dc2365c8862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1270d2a0-b801-440f-a31d-9aacc7c70050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249dac1f0cb84a8aa9d48625b745ff58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2f70450-8948-4758-933a-630c298efc09,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:23Z,use_quota=True,user_id='beddb5fe7a074c4ba0a0776403614f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bacab1-5557-4fee-b4aa-c348bf59d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bacab1-5557-4fee-b4aa-c348bf59d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550b6f3-20d4-4218-b218-e4caa0c66ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550b6f3-20d4-4218-b218-e4caa0c66ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1270d2a0-b801-440f-a31d-9aacc7c70050', 'volume_name': 'volume-1270d2a0-b801-440f-a31d-9aacc7c70050', 'volume_size': 1, 'snapshot_id': 'f2f70450-8948-4758-933a-630c298efc09'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35274c5-9d1b-494c-84b0-5243473609e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35274c5-9d1b-494c-84b0-5243473609e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66b71e7-d5ac-4a9a-9033-3b73c9a94a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Volume 1270d2a0-b801-440f-a31d-9aacc7c70050: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1270d2a0-b801-440f-a31d-9aacc7c70050', 'volume_size': 1, 'snapshot_id': 'f2f70450-8948-4758-933a-630c298efc09'}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-quobyte-f2f70450-8948-4758-933a-630c298efc09-1270d2a0-b801-440f-a31d-9aacc7c70050" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-581f6c98-a740-457a-b5bd-3e53c3097578 req-d77b3643-2ca2-4488-9c95-fffb12ca9835 tempest-TestStampPattern-895444116 None] Terminate volume connection completed successfully.
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-581f6c98-a740-457a-b5bd-3e53c3097578 req-d77b3643-2ca2-4488-9c95-fffb12ca9835 tempest-TestStampPattern-895444116 None] Deleting attachment 12ff7d16-dc75-4cc1-9cf0-067d6fea9940. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-f2f70450-8948-4758-933a-630c298efc09-1270d2a0-b801-440f-a31d-9aacc7c70050" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Creating volume 1270d2a0-b801-440f-a31d-9aacc7c70050 from snapshot f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-quobyte-1270d2a0-b801-440f-a31d-9aacc7c70050" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-1270d2a0-b801-440f-a31d-9aacc7c70050" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] snapshot: f2f70450-8948-4758-933a-630c298efc09, volume: 1270d2a0-b801-440f-a31d-9aacc7c70050,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c81223-ae6c-46db-854a-7ee3f61c5046]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:23 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09
Nov 05 03:59:23 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:23 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dcd86f-4fc3-4aa8-a413-cca557e9ba71]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:23 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8
Nov 05 03:59:23 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:24 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:59:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:59:24 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:59:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:24 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050
Nov 05 03:59:24 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:30 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050" returned: 0 in 6.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:59:30 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Converted 1024.00 MB image at 160.87 MB/s
Nov 05 03:59:30 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 is being set with open permissions: ugo+rw
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:30 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050
Nov 05 03:59:30 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:30 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-1270d2a0-b801-440f-a31d-9aacc7c70050" released by "_copy_volume_from_snapshot" :: held 7.572s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-f2f70450-8948-4758-933a-630c298efc09-1270d2a0-b801-440f-a31d-9aacc7c70050" released by "_create_volume_from_snapshot" :: held 7.644s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.669s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.806s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Creating offline snapshot 30d67c09-382e-414b-9caf-f9984772efe1 of volume d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66b71e7-d5ac-4a9a-9033-3b73c9a94a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1270d2a0-b801-440f-a31d-9aacc7c70050', 'volume_size': 1, 'snapshot_id': 'f2f70450-8948-4758-933a-630c298efc09'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b29138-1d38-41dd-968f-9e425e4d88bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecd005a-1359-454a-a83a-8edd6bc46150]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Volume volume-1270d2a0-b801-440f-a31d-9aacc7c70050 (1270d2a0-b801-440f-a31d-9aacc7c70050): created successfully
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b29138-1d38-41dd-968f-9e425e4d88bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Flow 'volume_create_manager' (81447089-373c-49ca-8927-5d87bced8e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-84d08e3c-086a-4986-b13f-b36b7426bb7b tempest-SnapshotDependencyTests-704764046 None] Created volume successfully.
Nov 05 03:59:30 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b
Nov 05 03:59:30 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:31 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" returned: 0 in 0.407s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:31 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 1G
Nov 05 03:59:31 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:31 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 1G" returned: 0 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:31 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1
Nov 05 03:59:31 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-f2f70450-8948-4758-933a-630c298efc09-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-f2f70450-8948-4758-933a-630c298efc09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-quobyte-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-quobyte-f2f70450-8948-4758-933a-630c298efc09" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-f2f70450-8948-4758-933a-630c298efc09" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Deleting offline snapshot f2f70450-8948-4758-933a-630c298efc09 of volume 70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] snapshot_file for this snap is: volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0046c2-231b-490d-beca-7c2df2f92bda]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:31 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09
Nov 05 03:59:31 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:32 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 is being set with open permissions: ugo+rw
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:32 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1
Nov 05 03:59:32 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:32 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09" returned: 0 in 0.424s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5668186d-b9ef-4f39-a843-04b3c3ec3945]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:32 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:32 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8
Nov 05 03:59:32 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:32 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info
Nov 05 03:59:32 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:32 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info is being set with open permissions: ugo+rw
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:32 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info
Nov 05 03:59:32 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:32 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" returned: 0 in 0.636s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:32 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:32 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09
Nov 05 03:59:32 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.info" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e7fc06c9-4616-48ba-88d2-099c0ef24856 tempest-TestStampPattern-895444116 None] Create snapshot completed successfully
Nov 05 03:59:33 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:33 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09
Nov 05 03:59:33 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:33 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8.f2f70450-8948-4758-933a-630c298efc09" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-f2f70450-8948-4758-933a-630c298efc09" released by "_delete_snapshot" :: held 1.819s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" released by "delete_snapshot" :: held 1.844s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Created reservations ['af6f244a-0e2d-4152-8f48-f8e3f557e0de', '9fb6d1ed-1d4c-4d10-85af-e01f25d1394b', 'f1662342-b0f9-4834-80ba-e60cbeed4374', '7ffe5044-8128-40c8-aaef-da5b85163fe6'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:59:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Delete snapshot completed successfully.
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ceca9bbd-2e72-4abd-b04e-ea7026443944 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-f2f70450-8948-4758-933a-630c298efc09-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-quobyte-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6263958-4069-46b2-9084-17021cc96097]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:34 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8
Nov 05 03:59:34 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:34 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:34 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8
Nov 05 03:59:34 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:34 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" returned: 0 in 0.304s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8" released by "delete_volume" :: held 0.774s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Created reservations ['caf4a2b1-dc7d-4877-9d24-e5190ffdd325', 'e7f96288-ec65-4f0f-a343-d7c7cafa4b0b', 'e007026d-5142-4683-b003-3b69adacdbc2', '8eea8a4e-8cf9-425c-bed0-0cee2d781454'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:34 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:59:34 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-1270d2a0-b801-440f-a31d-9aacc7c70050-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-1270d2a0-b801-440f-a31d-9aacc7c70050-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "cinder-quobyte-1270d2a0-b801-440f-a31d-9aacc7c70050" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:35 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-1270d2a0-b801-440f-a31d-9aacc7c70050" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Deleted volume successfully.
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa1468e-5cf9-47bf-af6e-55caa78c532d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-084894e2-36b6-41fe-a430-3fc0cce3c67c tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-70cee2e4-36d1-4c50-a0b2-c27c3ae875b8-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:35 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050
Nov 05 03:59:35 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:35 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050" returned: 0 in 0.414s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:35 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050
Nov 05 03:59:35 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:36 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1270d2a0-b801-440f-a31d-9aacc7c70050" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-quobyte-1270d2a0-b801-440f-a31d-9aacc7c70050" released by "delete_volume" :: held 0.735s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Created reservations ['0343dcdc-8235-48a9-b6f6-b8710774334e', 'ce597e6c-9781-4701-8f85-6ac12ee79892', '126207ca-d4ba-4501-a40a-1715efa04a44', 'c09ebed8-e52c-43ef-8eee-36dfdc8fc804'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:36 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 03:59:36 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:36 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 03:59:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Deleted volume successfully.
Nov 05 03:59:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-5cb2863b-c3e3-4675-8d22-d470a5fa3236 tempest-SnapshotDependencyTests-704764046 None] Lock "cinder-1270d2a0-b801-440f-a31d-9aacc7c70050-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Flow 'volume_create_manager' (7bac4e74-45b6-4b86-9a60-a8d344bc8afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a36814d-aeda-4f32-9836-9ad701ac51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a36814d-aeda-4f32-9836-9ad701ac51d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T02:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-800587971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ba2cd4-590c-47db-973f-4d9802e056ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be852870c2034a08890c42abffad110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30d67c09-382e-414b-9caf-f9984772efe1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:41Z,use_quota=True,user_id='97f6d7eac4d142d487a0f17f4117b765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e51992-19f8-4336-9607-c54ca87e993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e51992-19f8-4336-9607-c54ca87e993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629c011c-f69d-468a-8e89-c5985f9a25e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629c011c-f69d-468a-8e89-c5985f9a25e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12ba2cd4-590c-47db-973f-4d9802e056ec', 'volume_name': 'volume-12ba2cd4-590c-47db-973f-4d9802e056ec', 'volume_size': 1, 'snapshot_id': '30d67c09-382e-414b-9caf-f9984772efe1'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93075868-9f79-4c19-a69f-cc6a0b64f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93075868-9f79-4c19-a69f-cc6a0b64f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c608a-bb87-44b8-87a6-9b5d1ad99572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Volume 12ba2cd4-590c-47db-973f-4d9802e056ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12ba2cd4-590c-47db-973f-4d9802e056ec', 'volume_size': 1, 'snapshot_id': '30d67c09-382e-414b-9caf-f9984772efe1'}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-quobyte-30d67c09-382e-414b-9caf-f9984772efe1-12ba2cd4-590c-47db-973f-4d9802e056ec" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-30d67c09-382e-414b-9caf-f9984772efe1-12ba2cd4-590c-47db-973f-4d9802e056ec" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Creating volume 12ba2cd4-590c-47db-973f-4d9802e056ec from snapshot 30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-quobyte-12ba2cd4-590c-47db-973f-4d9802e056ec" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-12ba2cd4-590c-47db-973f-4d9802e056ec" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] snapshot: 30d67c09-382e-414b-9caf-f9984772efe1, volume: 12ba2cd4-590c-47db-973f-4d9802e056ec,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[977dca15-7547-4296-ba2a-e20731c38bc0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:41 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1
Nov 05 03:59:41 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:41 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1" returned: 0 in 0.477s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d36d4b0-24bd-4e1a-a356-ecefe5014e12]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:41 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b
Nov 05 03:59:41 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:41 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" returned: 0 in 0.454s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 03:59:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:41 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec
Nov 05 03:59:41 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:50 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec" returned: 0 in 8.701s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 03:59:50 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Converted 1024.00 MB image at 117.65 MB/s
Nov 05 03:59:50 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec is being set with open permissions: ugo+rw
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 03:59:50 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec
Nov 05 03:59:50 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=35,cinder:SELECT=39,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=41,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 03:59:50 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-12ba2cd4-590c-47db-973f-4d9802e056ec" released by "_copy_volume_from_snapshot" :: held 10.046s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-30d67c09-382e-414b-9caf-f9984772efe1-12ba2cd4-590c-47db-973f-4d9802e056ec" released by "_create_volume_from_snapshot" :: held 10.127s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.159s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c608a-bb87-44b8-87a6-9b5d1ad99572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ba2cd4-590c-47db-973f-4d9802e056ec', 'volume_size': 1, 'snapshot_id': '30d67c09-382e-414b-9caf-f9984772efe1'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ffba89-7e83-40e1-860c-82501f5d36f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 03:59:50 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Volume volume-12ba2cd4-590c-47db-973f-4d9802e056ec (12ba2cd4-590c-47db-973f-4d9802e056ec): created successfully
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ffba89-7e83-40e1-860c-82501f5d36f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 03:59:50 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Flow 'volume_create_manager' (7bac4e74-45b6-4b86-9a60-a8d344bc8afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 03:59:50 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ec65246c-e03d-4630-b830-f7c6a02e3bf6 tempest-TestStampPattern-895444116 None] Created volume successfully.
Nov 05 04:00:00 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:00 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:08 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:00:08 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:08 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 04:00:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 04:00:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3a1cf8b0-297d-4eaf-8fd7-8281fe6369cb req-1930f89b-4528-43a8-af24-f9da34b3f137 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3a1cf8b0-297d-4eaf-8fd7-8281fe6369cb req-1930f89b-4528-43a8-af24-f9da34b3f137 tempest-TestStampPattern-895444116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [req-3a1cf8b0-297d-4eaf-8fd7-8281fe6369cb req-1930f89b-4528-43a8-af24-f9da34b3f137 tempest-TestStampPattern-895444116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-3a1cf8b0-297d-4eaf-8fd7-8281fe6369cb req-1930f89b-4528-43a8-af24-f9da34b3f137 tempest-TestStampPattern-895444116 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318', 'name': 'volume-12ba2cd4-590c-47db-973f-4d9802e056ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d642f23-f5f7-4846-b700-ab4e63b2bfda', 'enforce_multipath': True} {{(pid=87098) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}}
Nov 05 04:00:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-3a1cf8b0-297d-4eaf-8fd7-8281fe6369cb req-1930f89b-4528-43a8-af24-f9da34b3f137 tempest-TestStampPattern-895444116 None] attachment_update completed successfully.
Nov 05 04:00:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [req-af95abcd-1e94-4cf2-af97-cf3d746a4a81 req-b1636e32-f5ca-4764-8936-4b15bcf7d940 tempest-TestStampPattern-895444116 None] Terminate volume connection completed successfully.
Nov 05 04:00:36 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [req-af95abcd-1e94-4cf2-af97-cf3d746a4a81 req-b1636e32-f5ca-4764-8936-4b15bcf7d940 tempest-TestStampPattern-895444116 None] Deleting attachment 5d642f23-f5f7-4846-b700-ab4e63b2bfda. {{(pid=87098) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}}
Nov 05 04:00:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-12ba2cd4-590c-47db-973f-4d9802e056ec-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Lock "cinder-12ba2cd4-590c-47db-973f-4d9802e056ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-quobyte-12ba2cd4-590c-47db-973f-4d9802e056ec" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-12ba2cd4-590c-47db-973f-4d9802e056ec" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa824771-ee35-49af-ae65-120947f05a6a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:41 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec
Nov 05 04:00:41 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:41 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec" returned: 0 in 0.382s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:41 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec
Nov 05 04:00:41 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:41 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-12ba2cd4-590c-47db-973f-4d9802e056ec" returned: 0 in 0.264s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-12ba2cd4-590c-47db-973f-4d9802e056ec" released by "delete_volume" :: held 0.690s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Created reservations ['14f7db3f-0fcb-4c33-9d3e-895169ae1209', '7731256e-1bbe-4fa4-94c8-82a752602d27', '1a0cf10e-53a5-4e91-bfa9-918897d4cdde', '6c25d3e7-819a-4e8d-a8bb-d372b4aaf2c1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:41 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:00:41 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:42 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.277s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Deleted volume successfully.
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-754c0eef-3598-469e-be56-ddae914fe003 tempest-TestStampPattern-895444116 None] Lock "cinder-12ba2cd4-590c-47db-973f-4d9802e056ec-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-30d67c09-382e-414b-9caf-f9984772efe1-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Lock "cinder-30d67c09-382e-414b-9caf-f9984772efe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-quobyte-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-quobyte-30d67c09-382e-414b-9caf-f9984772efe1" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-30d67c09-382e-414b-9caf-f9984772efe1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Deleting offline snapshot 30d67c09-382e-414b-9caf-f9984772efe1 of volume d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] snapshot_file for this snap is: volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c62e4-760a-45bd-8b46-2fd78e3bf348]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:42 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1
Nov 05 04:00:42 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:42 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1" returned: 0 in 0.401s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[189bef94-6bc3-4979-b5a7-35bfb35c7798]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:42 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b
Nov 05 04:00:42 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:43 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" returned: 0 in 0.563s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:43 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1
Nov 05 04:00:43 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:43 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:43 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1
Nov 05 04:00:43 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:44 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b.30d67c09-382e-414b-9caf-f9984772efe1" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-30d67c09-382e-414b-9caf-f9984772efe1" released by "_delete_snapshot" :: held 1.701s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" released by "delete_snapshot" :: held 1.724s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:44 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Created reservations ['af7e4d64-4816-4b78-b66f-3eae195d7de2', '792f3fe5-9147-4444-ad5c-55e1f1b69db6', 'dad0b1f3-f8f4-4ede-a1a7-bc5599755ac9', '2dc49643-f12a-4f92-8315-499a48e8e5c1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:44 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Delete snapshot completed successfully.
Nov 05 04:00:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a13843aa-53b0-44d0-a1cf-682c5da849d9 tempest-TestStampPattern-895444116 None] Lock "cinder-30d67c09-382e-414b-9caf-f9984772efe1-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Lock "cinder-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Acquiring lock "cinder-quobyte-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beffbbb-258f-4599-9369-3ba6fafbe24d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:48 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b
Nov 05 04:00:48 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:48 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:48 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b
Nov 05 04:00:48 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:48 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Lock "cinder-quobyte-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b" released by "delete_volume" :: held 0.758s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Created reservations ['e61b5640-3d5c-4250-ab49-480431364746', '6c79c1ef-8d4f-47fa-8160-93c2b222457c', '19eaa472-9d63-4cd8-887c-e9b0d50cefbd', 'b88ee6c3-dfc4-45a5-8d7b-d9529ad5bb7a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:00:49 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:00:49 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:00:49 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.264s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:00:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Deleted volume successfully.
Nov 05 04:00:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2374980e-a06d-4dd0-8f5e-aa8e03012e13 tempest-TestStampPattern-895444116 None] Lock "cinder-d502f30e-b109-4b09-bf12-c9fd7f6b0c9b-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:00:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:00:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (cacace58-a89a-45c7-b608-ac7f02e4e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a6c982-a0f2-4cbf-b932-a697d7ebfe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a6c982-a0f2-4cbf-b932-a697d7ebfe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-382569770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:02Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41d3365-7e54-4ef3-9451-9833f4178cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41d3365-7e54-4ef3-9451-9833f4178cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ce1d8c-6a43-4e54-a71b-f2eec8c7a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ce1d8c-6a43-4e54-a71b-f2eec8c7a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370', 'volume_name': 'volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ec4f10-0a12-4db2-ae56-5bfe41c56c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ec4f10-0a12-4db2-ae56-5bfe41c56c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ee876-3ad5-4235-a24a-e6e7e9ec9652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Volume da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370', 'volume_size': 1}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-382569770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:02Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Creating volume da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:02 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:02 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 1073741824
Nov 05 04:01:02 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (ac98abf8-f58d-4020-a3ad-40a78394d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ba185d-8c48-4f92-b275-a6b40f16954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ba185d-8c48-4f92-b275-a6b40f16954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1120176881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:03Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb5ea18-37ea-493d-8de7-6bfb30cbbedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb5ea18-37ea-493d-8de7-6bfb30cbbedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5965ecc8-b492-4c9f-9080-3b362ce0dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5965ecc8-b492-4c9f-9080-3b362ce0dee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50', 'volume_name': 'volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49504973-89ac-4c16-91fb-f0d13a8652ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49504973-89ac-4c16-91fb-f0d13a8652ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963cba6a-3199-4bcb-b8e5-04c991b0e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Volume 28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50', 'volume_size': 1}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:02 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 1073741824" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:02 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370
Nov 05 04:01:02 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (ccf5dc7e-c43f-495a-8f9a-0dc7d55739f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dd3764-7b19-4e77-8161-29a797c53d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dd3764-7b19-4e77-8161-29a797c53d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824115107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c8280b-acf0-490b-becc-0c3f721cb856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:03Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467984ab-89f3-4d3c-b2d1-a8c26e9bc05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467984ab-89f3-4d3c-b2d1-a8c26e9bc05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfc2aae-66ac-4b4d-95ba-1beb6da9a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfc2aae-66ac-4b4d-95ba-1beb6da9a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c8280b-acf0-490b-becc-0c3f721cb856', 'volume_name': 'volume-a7c8280b-acf0-490b-becc-0c3f721cb856', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be093a51-ec97-4633-a9b9-12b31ef7bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be093a51-ec97-4633-a9b9-12b31ef7bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77925924-6841-40ed-af7d-b9f2254c1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Volume a7c8280b-acf0-490b-becc-0c3f721cb856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c8280b-acf0-490b-becc-0c3f721cb856', 'volume_size': 1}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:03 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370" returned: 0 in 0.293s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1120176881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:03Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Creating volume 28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:03 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ee876-3ad5-4235-a24a-e6e7e9ec9652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 1073741824
Nov 05 04:01:03 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa7d54b-2cd2-4955-a419-7703c6426bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Volume volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 (da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370): created successfully
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa7d54b-2cd2-4955-a419-7703c6426bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (cacace58-a89a-45c7-b608-ac7f02e4e77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3b991428-ec40-4d4d-ad2f-bf7c9044ac45 tempest-CreateVolumesFromImageTest-331134229 None] Created volume successfully.
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (7a0018ba-2029-4ca0-845f-239d9b0fcb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372a86f6-11e0-458e-9ed6-ab47f29938b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372a86f6-11e0-458e-9ed6-ab47f29938b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2094127192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3a228d-6f66-48f9-8812-7ac4de70bd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:03Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30648888-cca3-4589-833e-55e1ca0f6994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30648888-cca3-4589-833e-55e1ca0f6994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f4698c-e5fc-4d8b-b29f-40f6cf80df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f4698c-e5fc-4d8b-b29f-40f6cf80df1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3a228d-6f66-48f9-8812-7ac4de70bd36', 'volume_name': 'volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59b3e5f-34ae-4079-8723-3ed5422402f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59b3e5f-34ae-4079-8723-3ed5422402f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ab5a6-2d5d-47f2-bbeb-8f28f7a4579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Volume 1a3a228d-6f66-48f9-8812-7ac4de70bd36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36', 'volume_size': 1}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:03 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 1073741824" returned: 0 in 0.576s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:03 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50
Nov 05 04:01:03 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (efdfa367-f0f2-4d3f-a8bf-c0f957dc13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73319a3-5974-49cf-9c0f-b8272b2f90e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73319a3-5974-49cf-9c0f-b8272b2f90e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-656358933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:04Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aca201e-d9ec-4fac-9ea5-0ca923406db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aca201e-d9ec-4fac-9ea5-0ca923406db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b548f9da-67a8-4786-94b7-340c004db44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b548f9da-67a8-4786-94b7-340c004db44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b', 'volume_name': 'volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f5f36a-89a9-40c8-a5e6-7760ede9bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f5f36a-89a9-40c8-a5e6-7760ede9bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4855dfbe-e010-46b9-a413-e99446c04faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Volume 75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b', 'volume_size': 1}
Nov 05 04:01:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:04 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824115107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c8280b-acf0-490b-becc-0c3f721cb856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:03Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Creating volume a7c8280b-acf0-490b-becc-0c3f721cb856 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963cba6a-3199-4bcb-b8e5-04c991b0e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:04 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856 1073741824
Nov 05 04:01:04 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b66a59-782e-46d7-9252-8865096c468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Volume volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 (28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50): created successfully
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b66a59-782e-46d7-9252-8865096c468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (ac98abf8-f58d-4020-a3ad-40a78394d838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5321c63d-3b53-4479-baec-964c9cac5497 tempest-CreateVolumesFromImageTest-331134229 None] Created volume successfully.
Nov 05 04:01:04 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856 1073741824" returned: 0 in 0.437s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:04 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856
Nov 05 04:01:04 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:04 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2094127192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3a228d-6f66-48f9-8812-7ac4de70bd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:03Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Creating volume 1a3a228d-6f66-48f9-8812-7ac4de70bd36 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77925924-6841-40ed-af7d-b9f2254c1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c8280b-acf0-490b-becc-0c3f721cb856', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:04 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 1073741824
Nov 05 04:01:04 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06a0fea-2a28-4cf4-9c75-7ec65ca89978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Volume volume-a7c8280b-acf0-490b-becc-0c3f721cb856 (a7c8280b-acf0-490b-becc-0c3f721cb856): created successfully
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06a0fea-2a28-4cf4-9c75-7ec65ca89978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (ccf5dc7e-c43f-495a-8f9a-0dc7d55739f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9b45dd7a-7635-4fc2-9409-6be18dc4ced2 tempest-CreateVolumesFromImageTest-331134229 None] Created volume successfully.
Nov 05 04:01:05 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 1073741824" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:05 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36
Nov 05 04:01:05 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:05 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-656358933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce774feda02941e9afd5a0c8d3b188cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:04Z,use_quota=True,user_id='333e5ebeddec4811820011e371964f9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Creating volume 75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:05 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:05 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b 1073741824
Nov 05 04:01:05 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ab5a6-2d5d-47f2-bbeb-8f28f7a4579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58339d1-2239-45cb-a427-e7c43a844880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Volume volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 (1a3a228d-6f66-48f9-8812-7ac4de70bd36): created successfully
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58339d1-2239-45cb-a427-e7c43a844880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (7a0018ba-2029-4ca0-845f-239d9b0fcb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-478ed36e-1592-4ddf-a308-30385235d154 tempest-CreateVolumesFromImageTest-331134229 None] Created volume successfully.
Nov 05 04:01:06 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b 1073741824" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:06 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b
Nov 05 04:01:06 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:06 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4855dfbe-e010-46b9-a413-e99446c04faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc5a763-064f-450a-9890-a95832235c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:06 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Volume volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b (75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b): created successfully
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc5a763-064f-450a-9890-a95832235c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:06 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Flow 'volume_create_manager' (efdfa367-f0f2-4d3f-a8bf-c0f957dc13b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:06 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7b31e3df-a057-41da-a06c-ab3c2c55eb27 tempest-CreateVolumesFromImageTest-331134229 None] Created volume successfully.
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-quobyte-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f7500-2890-4f26-ac99-bc1bb041bf72]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:07 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b
Nov 05 04:01:07 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:07 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:07 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b
Nov 05 04:01:07 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:08 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b" released by "delete_volume" :: held 0.674s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Created reservations ['e9166a85-9e4c-4ae9-92db-c90f62da411d', 'b200a18d-2b54-41eb-b0a9-558f13bb1b70', 'f14c7c05-a713-451a-a413-e5e3767091f7', '35684fc4-036c-4c1d-a562-e7e2e69345fc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:08 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:08 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:08 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Deleted volume successfully.
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-1a3a228d-6f66-48f9-8812-7ac4de70bd36-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-1a3a228d-6f66-48f9-8812-7ac4de70bd36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c27d2bb4-0d98-42e2-974c-4c4f78d4f054 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-75bc173c-b2dc-4a4d-81a4-cf7b10d9b72b-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-quobyte-1a3a228d-6f66-48f9-8812-7ac4de70bd36" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-1a3a228d-6f66-48f9-8812-7ac4de70bd36" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[35381b63-9718-4c8d-930b-9624e50e1ac6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:08 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36
Nov 05 04:01:08 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:08 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:08 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:08 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:08 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 04:01:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 04:01:09 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36
Nov 05 04:01:09 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:09 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1a3a228d-6f66-48f9-8812-7ac4de70bd36" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-1a3a228d-6f66-48f9-8812-7ac4de70bd36" released by "delete_volume" :: held 0.678s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Created reservations ['386d2ed2-5146-49c5-906e-467976a363aa', '35f19ab9-19fa-4c48-8eeb-03987ad0ceec', 'eb51e4e1-1346-4554-877b-145900c1712a', '72ffba33-0a70-4792-b821-eebdd4497649'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:09 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:09 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:09 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:09 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Deleted volume successfully.
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-a7c8280b-acf0-490b-becc-0c3f721cb856-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-959d600a-ba3a-4597-b19d-5d2dc5f7cfce tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-1a3a228d-6f66-48f9-8812-7ac4de70bd36-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-a7c8280b-acf0-490b-becc-0c3f721cb856-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-quobyte-a7c8280b-acf0-490b-becc-0c3f721cb856" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-a7c8280b-acf0-490b-becc-0c3f721cb856" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd54be62-0b3f-4398-9adc-ddb6367b4272]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:09 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856
Nov 05 04:01:09 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:10 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856
Nov 05 04:01:10 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a7c8280b-acf0-490b-becc-0c3f721cb856" returned: 0 in 0.251s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-a7c8280b-acf0-490b-becc-0c3f721cb856" released by "delete_volume" :: held 0.697s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Created reservations ['4750ce3e-bb3f-41b6-9b2e-689986aeceda', '54b0247e-f57f-40be-a5c8-315745e53248', '4f94d29a-6813-46ea-baf2-50de4afd7b1c', 'b83565db-e6a7-4f7d-bd95-de160381aa0b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:10 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:10 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:10 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Deleted volume successfully.
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-0b9ad529-b781-408b-a1cd-a687a978205c tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-a7c8280b-acf0-490b-becc-0c3f721cb856-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-quobyte-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579e5c2-8147-4529-829d-caad7a312fe0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:11 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50
Nov 05 04:01:11 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:11 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:11 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50
Nov 05 04:01:11 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:11 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50" returned: 0 in 0.261s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50" released by "delete_volume" :: held 0.671s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Created reservations ['2e0a33af-9804-4877-90dc-eb64fedf5f45', 'a709534e-ca39-427c-ad10-13b45651485e', '3a74472e-de25-4489-9901-fc2661e98d18', '301b058d-ac11-4d03-8efc-3a046d158de9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:11 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:11 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:12 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.241s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Deleted volume successfully.
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-52818ce6-ad5d-4db1-b1f4-132e22099524 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-28cdb78b-4a0a-42cf-a6e7-7bd34b21eb50-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "cinder-quobyte-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2f509a-b916-4f45-9542-3d91d528f08b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:12 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370
Nov 05 04:01:12 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:12 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:12 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370
Nov 05 04:01:12 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:12 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-quobyte-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370" released by "delete_volume" :: held 0.682s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Created reservations ['bbf769a4-8def-4912-ac46-cd3f8d08eafe', 'c2935417-662f-4a1e-8a47-b247cc1a4220', '22cec299-abbb-45ae-9eea-4aac0f06511a', '0332676d-cc2a-468b-a6d0-54f48ffc85be'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:12 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:12 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:13 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:13 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Deleted volume successfully.
Nov 05 04:01:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-aff65d2d-726d-4281-ae21-efc3be3978f4 tempest-CreateVolumesFromImageTest-331134229 None] Lock "cinder-da4f3d4d-b4dc-4f6a-a7b9-9c79a2d9e370-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Flow 'volume_create_manager' (13a110ca-e646-4865-9c98-c47d6238eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6981fcfd-fe60-4b14-ae63-d2f80bf93d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6981fcfd-fe60-4b14-ae63-d2f80bf93d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1083951269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6610b0e3-3415-42aa-8e34-cce3833e63ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19fdd68018b4eb18b37d025d5094024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:16Z,use_quota=True,user_id='a5c41f64371c4e4a9f87c60cb5fdf860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4942a99-bce9-40b3-9ebd-9022c8627240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4942a99-bce9-40b3-9ebd-9022c8627240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa09527-200a-40c9-a126-0718757840c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa09527-200a-40c9-a126-0718757840c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6610b0e3-3415-42aa-8e34-cce3833e63ad', 'volume_name': 'volume-6610b0e3-3415-42aa-8e34-cce3833e63ad', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b21e264-ad4b-4bb0-a7b6-484f8bdffa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b21e264-ad4b-4bb0-a7b6-484f8bdffa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27263cc1-08dd-446e-aa7f-32f5468fc7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Volume 6610b0e3-3415-42aa-8e34-cce3833e63ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6610b0e3-3415-42aa-8e34-cce3833e63ad', 'volume_size': 1}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1083951269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6610b0e3-3415-42aa-8e34-cce3833e63ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19fdd68018b4eb18b37d025d5094024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:16Z,use_quota=True,user_id='a5c41f64371c4e4a9f87c60cb5fdf860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Creating volume 6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:16 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:16 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad 1073741824
Nov 05 04:01:16 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:16 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad 1073741824" returned: 0 in 0.498s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:16 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad
Nov 05 04:01:16 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:17 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27263cc1-08dd-446e-aa7f-32f5468fc7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6610b0e3-3415-42aa-8e34-cce3833e63ad', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc0444c-f9e1-41bf-8f86-dfcb6b049ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:17 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Volume volume-6610b0e3-3415-42aa-8e34-cce3833e63ad (6610b0e3-3415-42aa-8e34-cce3833e63ad): created successfully
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc0444c-f9e1-41bf-8f86-dfcb6b049ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Flow 'volume_create_manager' (13a110ca-e646-4865-9c98-c47d6238eb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ffa25420-2046-409f-924e-96fa56041d2f tempest-VolumeDependencyTests-87837630 None] Created volume successfully.
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Creating offline snapshot 46845f65-676a-44ea-9ce4-8b205ff6d01f of volume 6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[53203801-5dde-41cc-af68-82abab9f47a2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:18 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad
Nov 05 04:01:18 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:18 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad" returned: 0 in 0.387s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:19 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f 1G
Nov 05 04:01:19 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:19 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f 1G" returned: 0 in 0.466s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6610b0e3-3415-42aa-8e34-cce3833e63ad -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:19 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6610b0e3-3415-42aa-8e34-cce3833e63ad -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f
Nov 05 04:01:19 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:19 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6610b0e3-3415-42aa-8e34-cce3833e63ad -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f" returned: 0 in 0.336s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:19 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f is being set with open permissions: ugo+rw
Nov 05 04:01:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:19 devstack sudo[107305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f
Nov 05 04:01:19 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:20 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:20 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info
Nov 05 04:01:20 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:20 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:20 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info is being set with open permissions: ugo+rw
Nov 05 04:01:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:20 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info
Nov 05 04:01:20 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:20 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.info" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9414a8fe-57c1-4dd6-9b70-09ea397f2692 tempest-VolumeDependencyTests-87837630 None] Create snapshot completed successfully
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Flow 'volume_create_manager' (d37f8aa8-3f27-47f5-9877-f30edc9f4481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967d484-3061-46e3-b1c8-e0439824b4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967d484-3061-46e3-b1c8-e0439824b4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1083754862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f903148-23c2-424b-9989-cccac4359cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19fdd68018b4eb18b37d025d5094024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46845f65-676a-44ea-9ce4-8b205ff6d01f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:22Z,use_quota=True,user_id='a5c41f64371c4e4a9f87c60cb5fdf860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dce866-5c75-4fd1-90a3-9b4e30641cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dce866-5c75-4fd1-90a3-9b4e30641cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727c160c-a16d-4f0b-a79f-7a6ffcfd248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727c160c-a16d-4f0b-a79f-7a6ffcfd248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f903148-23c2-424b-9989-cccac4359cc9', 'volume_name': 'volume-4f903148-23c2-424b-9989-cccac4359cc9', 'volume_size': 1, 'snapshot_id': '46845f65-676a-44ea-9ce4-8b205ff6d01f'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510d1855-8641-4b84-9e91-e177a8be7b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510d1855-8641-4b84-9e91-e177a8be7b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570e651d-6929-401e-85f3-191cebc1458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Volume 4f903148-23c2-424b-9989-cccac4359cc9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f903148-23c2-424b-9989-cccac4359cc9', 'volume_size': 1, 'snapshot_id': '46845f65-676a-44ea-9ce4-8b205ff6d01f'}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-quobyte-46845f65-676a-44ea-9ce4-8b205ff6d01f-4f903148-23c2-424b-9989-cccac4359cc9" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-46845f65-676a-44ea-9ce4-8b205ff6d01f-4f903148-23c2-424b-9989-cccac4359cc9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Creating volume 4f903148-23c2-424b-9989-cccac4359cc9 from snapshot 46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-quobyte-4f903148-23c2-424b-9989-cccac4359cc9" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-4f903148-23c2-424b-9989-cccac4359cc9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] snapshot: 46845f65-676a-44ea-9ce4-8b205ff6d01f, volume: 4f903148-23c2-424b-9989-cccac4359cc9,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02222b31-4f63-4140-8114-23541f6fc80d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:22 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f
Nov 05 04:01:22 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:22 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6610b0e3-3415-42aa-8e34-cce3833e63ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc7371b-040f-4d58-a062-13ebbea08cf6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:23 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad
Nov 05 04:01:23 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:23 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 04:01:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 04:01:23 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:01:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:23 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9
Nov 05 04:01:23 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:29 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9" returned: 0 in 6.229s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:01:29 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Converted 1024.00 MB image at 164.36 MB/s
Nov 05 04:01:29 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 is being set with open permissions: ugo+rw
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:29 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9
Nov 05 04:01:29 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:29 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9" returned: 0 in 0.271s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-4f903148-23c2-424b-9989-cccac4359cc9" released by "_copy_volume_from_snapshot" :: held 7.331s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-46845f65-676a-44ea-9ce4-8b205ff6d01f-4f903148-23c2-424b-9989-cccac4359cc9" released by "_create_volume_from_snapshot" :: held 7.401s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.418s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570e651d-6929-401e-85f3-191cebc1458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f903148-23c2-424b-9989-cccac4359cc9', 'volume_size': 1, 'snapshot_id': '46845f65-676a-44ea-9ce4-8b205ff6d01f'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a6f20f-e64d-4467-97d7-72ac5dcbef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Volume volume-4f903148-23c2-424b-9989-cccac4359cc9 (4f903148-23c2-424b-9989-cccac4359cc9): created successfully
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a6f20f-e64d-4467-97d7-72ac5dcbef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Flow 'volume_create_manager' (d37f8aa8-3f27-47f5-9877-f30edc9f4481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-95e1e234-f47b-4eff-8245-3eba076b4e03 tempest-VolumeDependencyTests-87837630 None] Created volume successfully.
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-46845f65-676a-44ea-9ce4-8b205ff6d01f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-46845f65-676a-44ea-9ce4-8b205ff6d01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-quobyte-6610b0e3-3415-42aa-8e34-cce3833e63ad" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-6610b0e3-3415-42aa-8e34-cce3833e63ad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-quobyte-46845f65-676a-44ea-9ce4-8b205ff6d01f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-46845f65-676a-44ea-9ce4-8b205ff6d01f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Deleting offline snapshot 46845f65-676a-44ea-9ce4-8b205ff6d01f of volume 6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] snapshot_file for this snap is: volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63a4e6-173d-4776-b569-6673055bb4b8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:31 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f
Nov 05 04:01:31 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:31 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f" returned: 0 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6610b0e3-3415-42aa-8e34-cce3833e63ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c850a181-d865-42df-8858-110256b70ab6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:31 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad
Nov 05 04:01:31 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:32 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad" returned: 0 in 0.582s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:32 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f
Nov 05 04:01:32 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:32 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:32 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f
Nov 05 04:01:32 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:32 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad.46845f65-676a-44ea-9ce4-8b205ff6d01f" returned: 0 in 0.255s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-46845f65-676a-44ea-9ce4-8b205ff6d01f" released by "_delete_snapshot" :: held 1.695s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-6610b0e3-3415-42aa-8e34-cce3833e63ad" released by "delete_snapshot" :: held 1.720s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Created reservations ['242f1011-94b5-4923-900d-fc403b8ed35a', '81f3cade-1514-435a-a209-4b1d56b0ff6b', '6c15a504-71f3-4e8e-933e-07d6cfccc605', '113efb12-9175-4c34-a1c5-93424951b9a9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Delete snapshot completed successfully.
Nov 05 04:01:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4e04102d-d10e-4076-83fd-5dd7acd1d6b2 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-46845f65-676a-44ea-9ce4-8b205ff6d01f-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-6610b0e3-3415-42aa-8e34-cce3833e63ad-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-6610b0e3-3415-42aa-8e34-cce3833e63ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-quobyte-6610b0e3-3415-42aa-8e34-cce3833e63ad" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-6610b0e3-3415-42aa-8e34-cce3833e63ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e15f5e-f224-4809-8522-d18738541e39]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:33 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad
Nov 05 04:01:33 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:33 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:33 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad
Nov 05 04:01:33 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:33 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6610b0e3-3415-42aa-8e34-cce3833e63ad" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-6610b0e3-3415-42aa-8e34-cce3833e63ad" released by "delete_volume" :: held 0.704s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Created reservations ['6d7a7a1c-0775-4a1c-bf2d-b0c10aa80b3c', 'a828473b-8001-4a83-88de-17408e6497f3', '9a30749b-9b3b-477b-8cff-411fc801be43', 'b01bec09-a818-4f1a-a3eb-79996f0db2a7'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:34 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:34 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-4f903148-23c2-424b-9989-cccac4359cc9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:34 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Lock "cinder-4f903148-23c2-424b-9989-cccac4359cc9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Deleted volume successfully.
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4d067a3f-0b3f-4b82-a058-16bfe017e297 tempest-VolumeDependencyTests-87837630 None] Lock "cinder-6610b0e3-3415-42aa-8e34-cce3833e63ad-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Acquiring lock "cinder-quobyte-4f903148-23c2-424b-9989-cccac4359cc9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-4f903148-23c2-424b-9989-cccac4359cc9" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1bdc9f-0ef4-48a0-9214-b69712af1dbc]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:34 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9
Nov 05 04:01:34 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:34 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:34 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9
Nov 05 04:01:34 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:35 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-4f903148-23c2-424b-9989-cccac4359cc9" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Lock "cinder-quobyte-4f903148-23c2-424b-9989-cccac4359cc9" released by "delete_volume" :: held 0.716s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Created reservations ['75cb4fd3-0451-4a62-b265-796298dce4a2', '477b64d0-15f6-408a-b5ea-9d025e980e78', '42d75b6d-da9f-4235-8d26-774f5563c6f8', 'c5dcd8e6-0864-43b0-af6c-832735036c73'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:35 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:35 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:35 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Deleted volume successfully.
Nov 05 04:01:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-35dae2bf-03cc-42cf-b989-ceaef310764b tempest-VolumeDependencyTests-87837630 None] Lock "cinder-4f903148-23c2-424b-9989-cccac4359cc9-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Flow 'volume_create_manager' (012bc890-b115-4c33-b118-1141c9e4b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8132108-0c56-4362-8170-fdfe0542479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8132108-0c56-4362-8170-fdfe0542479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af4f5dc-17cc-43a2-8e48-7c5de7676125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c260674a11cb4837a9f9bfeacc75aa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:41Z,use_quota=True,user_id='bb2af06197aa436eb47acb1e6834b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864f775e-8508-4175-833a-d63d80127177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864f775e-8508-4175-833a-d63d80127177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d94c8a-9add-4157-b7d8-b519ec585219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:40 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d94c8a-9add-4157-b7d8-b519ec585219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1af4f5dc-17cc-43a2-8e48-7c5de7676125', 'volume_name': 'volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125', 'volume_size': 1, 'image_id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1e437e6639c905a52499f19744f7a6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c260674a11cb4837a9f9bfeacc75aa69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4beed085b7468b7abf88506248450ab814f8bf25237b8015a4e4e66214c8c8a3aeabf2a5b227c581c64e871df45d15d25eef87a550588462da030c78e8b1141', 'id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b73509aed0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac733a1-d578-4d39-8973-ccc34408ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac733a1-d578-4d39-8973-ccc34408ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58774aad-5b62-469a-bff2-871f0c679150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Volume 1af4f5dc-17cc-43a2-8e48-7c5de7676125: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125', 'volume_size': 1, 'image_id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1e437e6639c905a52499f19744f7a6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c260674a11cb4837a9f9bfeacc75aa69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4beed085b7468b7abf88506248450ab814f8bf25237b8015a4e4e66214c8c8a3aeabf2a5b227c581c64e871df45d15d25eef87a550588462da030c78e8b1141', 'id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b73509aed0>}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Trying to clone 1af4f5dc-17cc-43a2-8e48-7c5de7676125 from image 7659c806-0e1b-41c2-8f2c-7341e1c5408b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 04:01:41 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d72ba-e9cb-4d75-9681-c2b5a3ab7630]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:41 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD
Nov 05 04:01:41 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:41 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:41 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD
Nov 05 04:01:41 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:41 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:41 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Temporary image 7659c806-0e1b-41c2-8f2c-7341e1c5408b is fetched for user bb2af06197aa436eb47acb1e6834b344. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[163d4e53-6f1e-445a-9121-a85fba34bf77]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD
Nov 05 04:01:42 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:42 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD
Nov 05 04:01:42 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:42 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af4f5dc-17cc-43a2-8e48-7c5de7676125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c260674a11cb4837a9f9bfeacc75aa69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:41Z,use_quota=True,user_id='bb2af06197aa436eb47acb1e6834b344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Creating volume 1af4f5dc-17cc-43a2-8e48-7c5de7676125 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:42 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:42 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 1073741824
Nov 05 04:01:42 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:43 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 1073741824" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:43 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125
Nov 05 04:01:43 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:43 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125" returned: 0 in 0.264s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Attempting download of 7659c806-0e1b-41c2-8f2c-7341e1c5408b ((None, [{'url': 'file:///opt/stack/data/glance/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'metadata': {}}])) to volume 1af4f5dc-17cc-43a2-8e48-7c5de7676125. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe755dbd-3d36-4299-85eb-99072b8289a5]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:43 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e
Nov 05 04:01:43 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:43 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e" returned: 0 in 0.342s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:44 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e
Nov 05 04:01:44 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:44 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e" returned: 1 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7659c806-0e1b-41c2-8f2c-7341e1c5408b_nuxzk58e' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5db37-8f6d-4c1c-bd67-f18dccf97318]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:44 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD
Nov 05 04:01:44 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:44 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:44 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD
Nov 05 04:01:44 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:44 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] 7659c806-0e1b-41c2-8f2c-7341e1c5408b was raw, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:45 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125
Nov 05 04:01:45 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:45 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7659c806-0e1b-41c2-8f2c-7341e1c5408b_x2y_rs7rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:01:45 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:45 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 1G
Nov 05 04:01:45 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:45 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 1G" returned: 0 in 0.353s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Downloaded image 7659c806-0e1b-41c2-8f2c-7341e1c5408b ((None, [{'url': 'file:///opt/stack/data/glance/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'metadata': {}}])) to volume 1af4f5dc-17cc-43a2-8e48-7c5de7676125 successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Temporary image 7659c806-0e1b-41c2-8f2c-7341e1c5408b for user bb2af06197aa436eb47acb1e6834b344 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Marking volume 1af4f5dc-17cc-43a2-8e48-7c5de7676125 as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Copying metadata from image 7659c806-0e1b-41c2-8f2c-7341e1c5408b to 1af4f5dc-17cc-43a2-8e48-7c5de7676125. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Creating volume glance metadata for volume 1af4f5dc-17cc-43a2-8e48-7c5de7676125 backed by image 7659c806-0e1b-41c2-8f2c-7341e1c5408b with: {'image_id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e1e437e6639c905a52499f19744f7a6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58774aad-5b62-469a-bff2-871f0c679150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125', 'volume_size': 1, 'image_id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1e437e6639c905a52499f19744f7a6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c260674a11cb4837a9f9bfeacc75aa69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4beed085b7468b7abf88506248450ab814f8bf25237b8015a4e4e66214c8c8a3aeabf2a5b227c581c64e871df45d15d25eef87a550588462da030c78e8b1141', 'id': '7659c806-0e1b-41c2-8f2c-7341e1c5408b', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7659c806-0e1b-41c2-8f2c-7341e1c5408b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b73509aed0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e15072e-2ff2-4421-b2c1-192b2f72234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:45 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Volume volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 (1af4f5dc-17cc-43a2-8e48-7c5de7676125): created successfully
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e15072e-2ff2-4421-b2c1-192b2f72234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:45 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Flow 'volume_create_manager' (012bc890-b115-4c33-b118-1141c9e4b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-388081d2-ce42-4a82-84f6-0763575efb42 tempest-VolumeImageDependencyTests-255436013 None] Created volume successfully.
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Acquiring lock "cinder-1af4f5dc-17cc-43a2-8e48-7c5de7676125-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Lock "cinder-1af4f5dc-17cc-43a2-8e48-7c5de7676125-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Acquiring lock "cinder-quobyte-1af4f5dc-17cc-43a2-8e48-7c5de7676125" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Lock "cinder-quobyte-1af4f5dc-17cc-43a2-8e48-7c5de7676125" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f22ce-95f3-41d2-8d82-61054e357dd1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:47 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125
Nov 05 04:01:47 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:47 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:47 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125
Nov 05 04:01:47 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:47 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1af4f5dc-17cc-43a2-8e48-7c5de7676125" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Lock "cinder-quobyte-1af4f5dc-17cc-43a2-8e48-7c5de7676125" released by "delete_volume" :: held 0.722s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Created reservations ['c59d1155-c781-4ea4-b2c3-0bebeb776388', '62ee1941-3f9f-4c62-a59b-310b94285850', '564f4ecb-70cf-4e75-bdfd-a269cf14434f', 'f6e3ce4d-8237-48f3-a39a-6ad764d5bff5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:48 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:48 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:48 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Deleted volume successfully.
Nov 05 04:01:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-30042e35-5c8d-4553-950d-cbe4c5d84dc5 tempest-VolumeImageDependencyTests-255436013 None] Lock "cinder-1af4f5dc-17cc-43a2-8e48-7c5de7676125-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (787e7ea0-fe9d-47cf-930d-6b16568248e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1166334b-c985-42e9-9a22-9ffc13f25624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1166334b-c985-42e9-9a22-9ffc13f25624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707511469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e7ecd2-df97-451f-ac32-c47c45b3e6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:52Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9735a0a0-7c66-4452-a570-13667b4d1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9735a0a0-7c66-4452-a570-13667b4d1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6bde32-4340-42b2-b201-44dc930d060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6bde32-4340-42b2-b201-44dc930d060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e7ecd2-df97-451f-ac32-c47c45b3e6c9', 'volume_name': 'volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d58bd0-7240-469e-9521-f685b965a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d58bd0-7240-469e-9521-f685b965a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd1dbb0-ae83-4455-afce-eaa36b7c02d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Volume f4e7ecd2-df97-451f-ac32-c47c45b3e6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9', 'volume_size': 1}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707511469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e7ecd2-df97-451f-ac32-c47c45b3e6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:52Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Creating volume f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:52 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:52 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 1073741824
Nov 05 04:01:52 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:53 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 1073741824" returned: 0 in 0.470s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:53 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9
Nov 05 04:01:53 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:53 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9" returned: 0 in 0.274s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd1dbb0-ae83-4455-afce-eaa36b7c02d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d765370-6ea4-4028-b2a8-2ba0e4177d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Volume volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 (f4e7ecd2-df97-451f-ac32-c47c45b3e6c9): created successfully
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d765370-6ea4-4028-b2a8-2ba0e4177d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (787e7ea0-fe9d-47cf-930d-6b16568248e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e3d621e3-247c-485d-ae23-41cacb8ee8bc tempest-ProjectReaderTests-159045752 None] Created volume successfully.
Nov 05 04:01:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Lock "cinder-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-quobyte-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[06303704-aac5-43e5-ad0a-dd79c19a4775]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:54 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9
Nov 05 04:01:54 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:55 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9" returned: 0 in 0.372s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:55 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9
Nov 05 04:01:55 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:55 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9" released by "delete_volume" :: held 0.692s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Created reservations ['14e70473-ba02-431e-b838-3b035c4d8cfa', 'fcf0caac-02fd-4c62-b192-88173aecea5e', '7e305d86-b928-431f-8a29-ed1081716a8b', 'a6b9a5dd-87ce-4736-b4b7-43dbb024d4cb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:55 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:55 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:55 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Deleted volume successfully.
Nov 05 04:01:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e29d7c41-ff26-4bbb-940b-4b15f74ae5f6 tempest-ProjectReaderTests-159045752 None] Lock "cinder-f4e7ecd2-df97-451f-ac32-c47c45b3e6c9-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (de4c12f8-2fb7-4526-b2ab-62dd8d1f0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736738bb-d032-4a85-89f6-65dab4132992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736738bb-d032-4a85-89f6-65dab4132992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603790969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:56Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4492ba-0d30-47cd-82f9-75a7a4f20840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4492ba-0d30-47cd-82f9-75a7a4f20840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2159a736-a5bc-46e9-b314-eecd4f6336b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2159a736-a5bc-46e9-b314-eecd4f6336b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1', 'volume_name': 'volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea1c5b2-831f-42cb-9474-73edd64dc6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea1c5b2-831f-42cb-9474-73edd64dc6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b80566-15ce-4e39-866b-27e2406bb42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Volume 8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1', 'volume_size': 1}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603790969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:56Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Creating volume 8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:01:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:56 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 1073741824
Nov 05 04:01:56 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:56 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 1073741824" returned: 0 in 0.478s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:57 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1
Nov 05 04:01:57 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:57 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b80566-15ce-4e39-866b-27e2406bb42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d598aa9-040c-4891-8b4e-87a6ab72ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:01:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Volume volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 (8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1): created successfully
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d598aa9-040c-4891-8b4e-87a6ab72ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:01:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (de4c12f8-2fb7-4526-b2ab-62dd8d1f0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:01:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-01bd8736-3bc6-4043-9053-a8bf01a82dcf tempest-ProjectReaderTests-159045752 None] Created volume successfully.
Nov 05 04:01:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Lock "cinder-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-quobyte-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:01:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:01:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0881268a-990a-498a-8f42-2e219ac4641e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:01:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:58 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1
Nov 05 04:01:58 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:59 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:59 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1
Nov 05 04:01:59 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:59 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1" returned: 0 in 0.252s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1" released by "delete_volume" :: held 0.704s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=87,cinder:UPDATE=116,cinder:INSERT=33,cinder:DELETE=11 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=107,cinder:SELECT=101,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Created reservations ['44f9981d-4d1f-4136-87ca-27362d0ee205', 'ffff5ea1-6f4a-4762-ab9e-e1887e08dd6d', 'ff338784-89c0-4f11-9869-f86ad3535ba8', '01524496-e82b-4fa3-aaa9-b7cc49d9dcb4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:01:59 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:01:59 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:01:59 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:01:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Deleted volume successfully.
Nov 05 04:01:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c2c64fcb-9c2c-48be-b03b-b474ff78db02 tempest-ProjectReaderTests-159045752 None] Lock "cinder-8219f9c9-16a9-4dc6-afd6-7ac26b2b2ab1-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (46589bc3-a6d4-4a9b-aefe-cd511932c630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f68fd3-762a-44d6-af64-a5bd4165fb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f68fd3-762a-44d6-af64-a5bd4165fb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21891184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bc3dd8-3c35-422c-964e-2db18db80de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:00Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6d945f-1c99-47a8-933d-98ad9c992946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6d945f-1c99-47a8-933d-98ad9c992946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3fea8c-a41b-49ad-9c8f-2e4b121831bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3fea8c-a41b-49ad-9c8f-2e4b121831bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65bc3dd8-3c35-422c-964e-2db18db80de9', 'volume_name': 'volume-65bc3dd8-3c35-422c-964e-2db18db80de9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8aa44b-547d-404b-adf7-db36b9ce46a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8aa44b-547d-404b-adf7-db36b9ce46a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ca2060-a778-4e41-9206-a3599a7aa91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Volume 65bc3dd8-3c35-422c-964e-2db18db80de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65bc3dd8-3c35-422c-964e-2db18db80de9', 'volume_size': 1}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-21891184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bc3dd8-3c35-422c-964e-2db18db80de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:00Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Creating volume 65bc3dd8-3c35-422c-964e-2db18db80de9 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:00 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9 1073741824
Nov 05 04:02:00 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:00 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9 1073741824" returned: 0 in 0.519s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:01 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9
Nov 05 04:02:01 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:01 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ca2060-a778-4e41-9206-a3599a7aa91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bc3dd8-3c35-422c-964e-2db18db80de9', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bffc0a8-a0d9-4100-a5d6-da2efe002611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Volume volume-65bc3dd8-3c35-422c-964e-2db18db80de9 (65bc3dd8-3c35-422c-964e-2db18db80de9): created successfully
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bffc0a8-a0d9-4100-a5d6-da2efe002611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (46589bc3-a6d4-4a9b-aefe-cd511932c630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9231e3a2-74d8-4a6f-bc09-bac79de37a7b tempest-ProjectReaderTests-159045752 None] Created volume successfully.
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-65bc3dd8-3c35-422c-964e-2db18db80de9-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Lock "cinder-65bc3dd8-3c35-422c-964e-2db18db80de9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-quobyte-65bc3dd8-3c35-422c-964e-2db18db80de9" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-65bc3dd8-3c35-422c-964e-2db18db80de9" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a731d79c-11c1-49db-9291-d7e1c829d2a9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:02 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9
Nov 05 04:02:02 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:02 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9" returned: 0 in 0.402s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:02 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9
Nov 05 04:02:02 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:03 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-65bc3dd8-3c35-422c-964e-2db18db80de9" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-65bc3dd8-3c35-422c-964e-2db18db80de9" released by "delete_volume" :: held 0.744s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Created reservations ['a84a8c5d-2ae5-462f-9f41-72a625f04934', '55b842cb-a71a-4dce-bc63-4818bc4abbea', '0f185a45-e59b-409a-a8cd-793fc9ec7eba', '750765f9-e4dd-4132-a9b2-1e6385d526c4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:03 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:03 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:03 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:03 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Deleted volume successfully.
Nov 05 04:02:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2b85533e-cfa3-4a53-8cfe-cacc9e412f93 tempest-ProjectReaderTests-159045752 None] Lock "cinder-65bc3dd8-3c35-422c-964e-2db18db80de9-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (43e2f39e-1822-468d-b8cf-4b46fc29b6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adfec2a-715e-45ff-882c-7d0859ed1ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adfec2a-715e-45ff-882c-7d0859ed1ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198312673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:04Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513442ee-efb1-4382-9a86-e016054c60ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513442ee-efb1-4382-9a86-e016054c60ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef70d66d-660e-4113-b474-3857a0b4d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef70d66d-660e-4113-b474-3857a0b4d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3', 'volume_name': 'volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7582b0-81ef-45c8-8d52-58eafda2763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7582b0-81ef-45c8-8d52-58eafda2763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ba5208-43a5-4002-9c49-5c664db0af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:04 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Volume cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3', 'volume_size': 1}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198312673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d9c2b04b1143ae92886254fdc70d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:04Z,use_quota=True,user_id='808d3282c1634467af736f8d98d3d771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Creating volume cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:04 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 1073741824
Nov 05 04:02:04 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:04 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 1073741824" returned: 0 in 0.479s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:04 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3
Nov 05 04:02:04 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:05 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ba5208-43a5-4002-9c49-5c664db0af96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5afc54-63e6-4c94-a394-365367fce8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Volume volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 (cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3): created successfully
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5afc54-63e6-4c94-a394-365367fce8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Flow 'volume_create_manager' (43e2f39e-1822-468d-b8cf-4b46fc29b6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-92f09e7a-c4e5-40c5-b784-e99d6053160e tempest-ProjectReaderTests-159045752 None] Created volume successfully.
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Lock "cinder-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Acquiring lock "cinder-quobyte-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2018e9da-bbec-4c66-8db3-a971bd8c478d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:06 devstack sudo[107566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3
Nov 05 04:02:06 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:06 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:06 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3
Nov 05 04:02:06 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Lock "cinder-quobyte-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3" released by "delete_volume" :: held 0.799s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Created reservations ['124ad6d0-6306-446c-bcb5-772628b78699', 'd1df02d7-ca8a-481a-9569-6f32161b09c0', '7028eb4c-ed9f-4147-8ca2-a6ec11694307', 'a0c3fe11-f522-4490-9556-53cc901a9b80'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:07 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:07 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:07 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.271s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Deleted volume successfully.
Nov 05 04:02:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-e6519072-a196-468b-8a1e-3ebb83a97eb0 tempest-ProjectReaderTests-159045752 None] Lock "cinder-cc4e86a0-1ae6-4b70-a3ec-19cbf3f685e3-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:08 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:08 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:08 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 04:02:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 04:02:17 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:02:17 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=30,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (00c9c9b8-8dab-411e-8113-337b43755790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9ae2de-ae0d-4c31-8368-6e885019b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9ae2de-ae0d-4c31-8368-6e885019b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731711019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f599a5b-bde0-4b1b-b590-492266fc713c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:21Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eef575-c0f0-40fc-8740-d767680b325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eef575-c0f0-40fc-8740-d767680b325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf0faa1-451a-49c3-96c3-7e2e7ef2d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf0faa1-451a-49c3-96c3-7e2e7ef2d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f599a5b-bde0-4b1b-b590-492266fc713c', 'volume_name': 'volume-6f599a5b-bde0-4b1b-b590-492266fc713c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bbc8b2-2650-4d4c-b4f5-fb230c43ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bbc8b2-2650-4d4c-b4f5-fb230c43ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a51fd7-4ace-4fef-a5aa-fa73b8856f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume 6f599a5b-bde0-4b1b-b590-492266fc713c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f599a5b-bde0-4b1b-b590-492266fc713c', 'volume_size': 1}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731711019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f599a5b-bde0-4b1b-b590-492266fc713c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:21Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating volume 6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:21 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:21 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c 1073741824
Nov 05 04:02:21 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Flow 'volume_create_manager' (49ef5b23-f22c-4e4a-977d-44748d0c1fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462fd565-c985-4463-afad-d1f2c4389e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462fd565-c985-4463-afad-d1f2c4389e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1810460639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376dd2d2-c8fd-4d29-bed4-56e133b1d9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe5e960e8804cb59120b83717a6ac57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='c76b9c9106ed4ee4808bb9c75538194e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1259efdf-7efa-4628-91d9-f35429fd04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1259efdf-7efa-4628-91d9-f35429fd04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ccf6be-899b-4310-85e3-355f1da228a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ccf6be-899b-4310-85e3-355f1da228a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376dd2d2-c8fd-4d29-bed4-56e133b1d9e8', 'volume_name': 'volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34f16c2-66e2-4f2e-9f94-962bcd366c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34f16c2-66e2-4f2e-9f94-962bcd366c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edf903b-7c2b-4b63-9bc2-1342f09e1cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Volume 376dd2d2-c8fd-4d29-bed4-56e133b1d9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8', 'volume_size': 1}
Nov 05 04:02:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:22 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (d467e735-d766-457b-aca1-b075da792a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857eb781-af39-45bb-ac8b-1bb6aafd5297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c 1073741824" returned: 0 in 0.704s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857eb781-af39-45bb-ac8b-1bb6aafd5297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4490852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a92a4e9-a7d6-4413-a134-57a2a29fcb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161b1ba7-b0b9-408c-96b2-88aa631d315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161b1ba7-b0b9-408c-96b2-88aa631d315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e297f203-f52f-4e8f-a758-ce62d59f3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e297f203-f52f-4e8f-a758-ce62d59f3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a92a4e9-a7d6-4413-a134-57a2a29fcb47', 'volume_name': 'volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6677f6ee-1837-444a-8c33-419bdf72aa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6677f6ee-1837-444a-8c33-419bdf72aa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea5a21d-4256-4109-976f-f4dab832a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume 3a92a4e9-a7d6-4413-a134-57a2a29fcb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47', 'volume_size': 1}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:22 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c
Nov 05 04:02:22 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:22 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1810460639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376dd2d2-c8fd-4d29-bed4-56e133b1d9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe5e960e8804cb59120b83717a6ac57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='c76b9c9106ed4ee4808bb9c75538194e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Creating volume 376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:22 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:22 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 1073741824
Nov 05 04:02:22 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a51fd7-4ace-4fef-a5aa-fa73b8856f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f599a5b-bde0-4b1b-b590-492266fc713c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba77ca07-3edc-4777-8c52-284833cdde8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume volume-6f599a5b-bde0-4b1b-b590-492266fc713c (6f599a5b-bde0-4b1b-b590-492266fc713c): created successfully
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba77ca07-3edc-4777-8c52-284833cdde8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (00c9c9b8-8dab-411e-8113-337b43755790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e944ff5d-e4db-46b7-ad7a-6c65c363492a tempest-CreateVolumesFromSnapshotTest-369974347 None] Created volume successfully.
Nov 05 04:02:23 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 1073741824" returned: 0 in 0.506s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:23 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8
Nov 05 04:02:23 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:23 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4490852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a92a4e9-a7d6-4413-a134-57a2a29fcb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:22Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Creating volume 3a92a4e9-a7d6-4413-a134-57a2a29fcb47 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:23 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edf903b-7c2b-4b63-9bc2-1342f09e1cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea82562-bef2-4414-b670-34f0be7c074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:23 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 1073741824
Nov 05 04:02:23 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:23 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Volume volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 (376dd2d2-c8fd-4d29-bed4-56e133b1d9e8): created successfully
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea82562-bef2-4414-b670-34f0be7c074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:23 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Flow 'volume_create_manager' (49ef5b23-f22c-4e4a-977d-44748d0c1fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1c0dc150-f892-4df7-a388-39b22d57933f tempest-VolumeDependencyTests-677649469 None] Created volume successfully.
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:24 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 1073741824" returned: 0 in 0.649s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:24 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47
Nov 05 04:02:24 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:24 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.404s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea5a21d-4256-4109-976f-f4dab832a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dad522-923f-477d-bb95-018eb6a3184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating offline snapshot 9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f of volume 6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 (3a92a4e9-a7d6-4413-a134-57a2a29fcb47): created successfully
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dad522-923f-477d-bb95-018eb6a3184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (d467e735-d766-457b-aca1-b075da792a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fcd945-a22a-467a-a4e3-91a65d724952]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5e68dedf-7fef-40e4-a276-99ef9e525577 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created volume successfully.
Nov 05 04:02:24 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c
Nov 05 04:02:24 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:24 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:25 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f 1G
Nov 05 04:02:25 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:25 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f 1G" returned: 0 in 0.518s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f599a5b-bde0-4b1b-b590-492266fc713c -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:25 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f599a5b-bde0-4b1b-b590-492266fc713c -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f
Nov 05 04:02:25 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:25 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f599a5b-bde0-4b1b-b590-492266fc713c -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:25 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f is being set with open permissions: ugo+rw
Nov 05 04:02:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:25 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f
Nov 05 04:02:25 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" returned: 0 in 0.354s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:26 devstack sudo[107664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (36261063-ddbe-47b2-8dcc-483b16c84d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:26 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aed0947-3b8e-4799-a204-7606a9e83296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aed0947-3b8e-4799-a204-7606a9e83296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978496174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364cb478-6a08-41d2-866a-ddda1941dc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:26Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cf0091-f800-45b0-b87d-a1a7fc3ea4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cf0091-f800-45b0-b87d-a1a7fc3ea4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfa9fb0-3c81-4af8-9ad3-e797eba966cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfa9fb0-3c81-4af8-9ad3-e797eba966cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364cb478-6a08-41d2-866a-ddda1941dc2c', 'volume_name': 'volume-364cb478-6a08-41d2-866a-ddda1941dc2c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1304a741-21f9-4128-9d3a-cfaf246c1725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1304a741-21f9-4128-9d3a-cfaf246c1725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8b39f2-d564-4cbb-8422-ace299166224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume 364cb478-6a08-41d2-866a-ddda1941dc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364cb478-6a08-41d2-866a-ddda1941dc2c', 'volume_size': 1}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Flow 'volume_create_manager' (ae84b7f5-f3dd-454f-b597-668f73a09a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246e5ee4-cec3-4cba-ad68-9a503bdde7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (246e5ee4-cec3-4cba-ad68-9a503bdde7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0424af8-fae9-418b-b3c7-124e8b94d24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f469d1796d9b45e4a909b758fd0095a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:26Z,use_quota=True,user_id='d3254a1f892b4447b65562a0a6268d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d45a509c-9695-4fea-b439-82c2589f3a71),volume_type_id=d45a509c-9695-4fea-b439-82c2589f3a71)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d89122-1a87-46b6-9d74-997f44b23a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d89122-1a87-46b6-9d74-997f44b23a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625df4b6-f305-428b-9543-44c77360f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (88a0e038-18ad-4e19-8bfe-43d5e559aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8caae60d-c872-40a6-908f-7aad93c3aedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8caae60d-c872-40a6-908f-7aad93c3aedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729688823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebe2879-2e68-4940-9d04-24514ddfe0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:27Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb0fd4f-ac96-419c-a236-674e1a66e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb0fd4f-ac96-419c-a236-674e1a66e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcc7c6d-2a88-4d6a-bf38-3f5fd414b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcc7c6d-2a88-4d6a-bf38-3f5fd414b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebe2879-2e68-4940-9d04-24514ddfe0a4', 'volume_name': 'volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572bf7ad-b543-47e4-87aa-89f15849f446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572bf7ad-b543-47e4-87aa-89f15849f446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad63f2-dbe7-4388-856e-90fb9084d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume 8ebe2879-2e68-4940-9d04-24514ddfe0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4', 'volume_size': 1}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:26 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info is being set with open permissions: ugo+rw
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:26 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info
Nov 05 04:02:26 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (0aa4f657-9eb7-484d-b267-6a796c933343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d03e40-e948-4515-94da-2ad7d606a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d03e40-e948-4515-94da-2ad7d606a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587155126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3412719-ecb2-4a24-afa2-45eeb4d4f07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:27Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d50803-91f9-4ad2-bf3e-a67c92cd0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d50803-91f9-4ad2-bf3e-a67c92cd0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8bf8d-ed9e-41c7-9872-d09bb7e202d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed8bf8d-ed9e-41c7-9872-d09bb7e202d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3412719-ecb2-4a24-afa2-45eeb4d4f07d', 'volume_name': 'volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a29a435-2d65-4d8e-90d5-9acd46b06fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a29a435-2d65-4d8e-90d5-9acd46b06fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367bf964-a634-496b-a2a9-c9ce1fb6b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume b3412719-ecb2-4a24-afa2-45eeb4d4f07d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d', 'volume_size': 1}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625df4b6-f305-428b-9543-44c77360f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0424af8-fae9-418b-b3c7-124e8b94d24e', 'volume_name': 'volume-a0424af8-fae9-418b-b3c7-124e8b94d24e', 'volume_size': 1, 'image_id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e454c854f63d6a892d415beee1729d02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f469d1796d9b45e4a909b758fd0095a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '938e1d177b25fb7074fcda4f07895252f6d822e143845621d9e7b2e6fb387b6574a6a258f3ba5c7a8aa92153e91e53ff52b947aea39021eabe2553cb9453cbe9', 'id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'created_at': datetime.datetime(2026, 11, 5, 3, 2, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 2, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72aec2ae0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6122b80-f372-41e4-9ed5-743ad564ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6122b80-f372-41e4-9ed5-743ad564ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dd9f79-9979-4f50-afa3-22aaa1766019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Volume a0424af8-fae9-418b-b3c7-124e8b94d24e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0424af8-fae9-418b-b3c7-124e8b94d24e', 'volume_size': 1, 'image_id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e454c854f63d6a892d415beee1729d02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f469d1796d9b45e4a909b758fd0095a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '938e1d177b25fb7074fcda4f07895252f6d822e143845621d9e7b2e6fb387b6574a6a258f3ba5c7a8aa92153e91e53ff52b947aea39021eabe2553cb9453cbe9', 'id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'created_at': datetime.datetime(2026, 11, 5, 3, 2, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 2, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72aec2ae0>}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Trying to clone a0424af8-fae9-418b-b3c7-124e8b94d24e from image df7a0fe5-c1a9-45eb-9900-8b62a895a2de at location (None, [{'url': 'file:///opt/stack/data/glance/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:02:27 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.info" returned: 0 in 0.389s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.160s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Creating offline snapshot 6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 of volume 376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 04:02:27 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b961dea-de39-4297-995d-13e59f33b8e8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-78d25191-afd6-413d-8307-5ddc52c51bea tempest-CreateVolumesFromSnapshotTest-369974347 None] Create snapshot completed successfully
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73cb06a-afdf-46a9-ae1c-4cd0ac61085d]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (d90b3c5b-0912-4e73-acf3-d4554eb3191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6418cae3-f608-493e-a720-48e6867500ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6418cae3-f608-493e-a720-48e6867500ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1565560565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62938b5-58a0-44d2-9e72-1ac40d718665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:27Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959a6cf1-f959-43e0-8f5e-784c5bd4de41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959a6cf1-f959-43e0-8f5e-784c5bd4de41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fa32e7-8fb9-4326-854d-5a633643eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fa32e7-8fb9-4326-854d-5a633643eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62938b5-58a0-44d2-9e72-1ac40d718665', 'volume_name': 'volume-d62938b5-58a0-44d2-9e72-1ac40d718665', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8
Nov 05 04:02:27 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6de206d-c18d-40f3-9a04-9263b85dbc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD
Nov 05 04:02:27 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6de206d-c18d-40f3-9a04-9263b85dbc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2c3505-c50d-44e8-be2e-138b7ec7d826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume d62938b5-58a0-44d2-9e72-1ac40d718665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62938b5-58a0-44d2-9e72-1ac40d718665', 'volume_size': 1}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:27 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" returned: 0 in 0.592s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:27 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 1G
Nov 05 04:02:27 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (49dec610-d4ec-4ef3-9d20-63d24f2ab87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f8a85d-d077-415f-8aa6-7689dc0dc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f8a85d-d077-415f-8aa6-7689dc0dc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431822976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f5ef9a-de74-45ff-8c78-a997466f3804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:28Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7324d3c5-0793-4f31-ace2-91316e66a2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7324d3c5-0793-4f31-ace2-91316e66a2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:27 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD
Nov 05 04:02:27 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc33cf-5578-451f-9d0e-e8c41f5118d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc33cf-5578-451f-9d0e-e8c41f5118d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f5ef9a-de74-45ff-8c78-a997466f3804', 'volume_name': 'volume-58f5ef9a-de74-45ff-8c78-a997466f3804', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8a8260-3ed0-487b-8828-d0d5368052cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8a8260-3ed0-487b-8828-d0d5368052cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02be42a9-013a-454f-b06a-3b979dcef344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume 58f5ef9a-de74-45ff-8c78-a997466f3804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f5ef9a-de74-45ff-8c78-a997466f3804', 'volume_size': 1}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:28 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Temporary image df7a0fe5-c1a9-45eb-9900-8b62a895a2de is fetched for user d3254a1f892b4447b65562a0a6268d55. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c413f99d-afa0-4404-9372-e10a70603b53]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 1G" returned: 0 in 0.541s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack sudo[107690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD
Nov 05 04:02:28 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20
Nov 05 04:02:28 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:28 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 is being set with open permissions: ugo+rw
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:28 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20
Nov 05 04:02:28 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (c1757af6-e02f-4b27-a681-b110f17fff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:28 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD
Nov 05 04:02:28 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3a576f-7383-4044-a4c1-d43a127544b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3a576f-7383-4044-a4c1-d43a127544b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268962497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a01ac1-9a26-45e1-b011-27eb67343da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:29Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ae1d97-6cc2-4baa-ab54-deaba5cf9984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ae1d97-6cc2-4baa-ab54-deaba5cf9984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010827e8-2d25-4893-b9f8-ec711aec9cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010827e8-2d25-4893-b9f8-ec711aec9cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a01ac1-9a26-45e1-b011-27eb67343da6', 'volume_name': 'volume-31a01ac1-9a26-45e1-b011-27eb67343da6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a317da95-2d50-4db5-ab03-ca9f3738dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a317da95-2d50-4db5-ab03-ca9f3738dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0314ef19-027e-4da9-8dd9-6daa1e1ecb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume 31a01ac1-9a26-45e1-b011-27eb67343da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a01ac1-9a26-45e1-b011-27eb67343da6', 'volume_size': 1}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" returned: 0 in 0.367s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:29 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info
Nov 05 04:02:29 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (6d3e1861-1c5f-4ad7-aef7-c690993b3da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337674bf-9394-46c7-a124-a6d5bc0e4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337674bf-9394-46c7-a124-a6d5bc0e4177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002002804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f29f29-ebe9-485b-8567-b8a68eba8a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:29Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed09862-a16a-4b51-a947-1159b566cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed09862-a16a-4b51-a947-1159b566cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed668e1f-dbf8-4b4d-9952-f0ef26ee7174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed668e1f-dbf8-4b4d-9952-f0ef26ee7174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f29f29-ebe9-485b-8567-b8a68eba8a4d', 'volume_name': 'volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24839964-dc96-40da-b6b2-d36560a94f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24839964-dc96-40da-b6b2-d36560a94f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03edf8ba-1cbf-4407-b138-1f5828173f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume 96f29f29-ebe9-485b-8567-b8a68eba8a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d', 'volume_size': 1}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:29 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info is being set with open permissions: ugo+rw
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:29 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info
Nov 05 04:02:29 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (4073c3aa-9428-4037-95ed-62a884e69ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0282671d-3af1-49b4-928b-5c7226b19cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0282671d-3af1-49b4-928b-5c7226b19cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994533326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2d0e51-e70d-45ff-a8f8-56040f0b5584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:30Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573b1a20-3284-4ee6-9a02-d34ebcd7ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573b1a20-3284-4ee6-9a02-d34ebcd7ed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d6fc93-3a06-4dfd-8629-40894e30f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d6fc93-3a06-4dfd-8629-40894e30f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2d0e51-e70d-45ff-a8f8-56040f0b5584', 'volume_name': 'volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a0ade0-448e-410d-bb19-4e9a7b93b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a0ade0-448e-410d-bb19-4e9a7b93b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098d98b1-556c-4b99-b1b7-070e7c215a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume 1d2d0e51-e70d-45ff-a8f8-56040f0b5584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584', 'volume_size': 1}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.info" returned: 0 in 0.293s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.516s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978496174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364cb478-6a08-41d2-866a-ddda1941dc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:26Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Creating volume 364cb478-6a08-41d2-866a-ddda1941dc2c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:29 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack sudo[107714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c 1073741824
Nov 05 04:02:30 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7c46649c-3bb1-4b07-b3cf-3f09e12fb9fd tempest-VolumeDependencyTests-677649469 None] Create snapshot completed successfully
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (ab138e67-22c1-4457-8527-26addc261af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d1522f-8dea-462d-ae71-175eba117a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d1522f-8dea-462d-ae71-175eba117a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640406808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d98ddcd-5416-414d-8f09-3c0e949dc6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:30Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcac665-4bd5-45b0-ad4b-c24cd6d0dd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcac665-4bd5-45b0-ad4b-c24cd6d0dd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82203cd4-1e07-4310-bdfb-eee5eab6e429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82203cd4-1e07-4310-bdfb-eee5eab6e429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d98ddcd-5416-414d-8f09-3c0e949dc6a3', 'volume_name': 'volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9203cfe3-7271-488b-a5cd-e6233ec6b8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9203cfe3-7271-488b-a5cd-e6233ec6b8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6351fa0e-f03a-442d-ad3d-c6d2192a7880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume 6d98ddcd-5416-414d-8f09-3c0e949dc6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3', 'volume_size': 1}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:30 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c 1073741824" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:30 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c
Nov 05 04:02:30 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (f14f4c2c-d418-4726-ae1e-1f65502ba829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c44164-02ad-4735-969c-4bf0fef766f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c44164-02ad-4735-969c-4bf0fef766f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240263941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6ac06b-e8fd-4990-8712-cdd410bdf921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:31Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4879f09b-1022-4cbe-97ff-618b3d7adf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4879f09b-1022-4cbe-97ff-618b3d7adf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5343ed-39d3-4987-8730-9692560248d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5343ed-39d3-4987-8730-9692560248d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6ac06b-e8fd-4990-8712-cdd410bdf921', 'volume_name': 'volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ab1f0d-fcda-432f-b8d5-9f9396c47f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ab1f0d-fcda-432f-b8d5-9f9396c47f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf27811-6018-48ec-91f5-d40b8c2dc202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume 6e6ac06b-e8fd-4990-8712-cdd410bdf921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921', 'volume_size': 1}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:30 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.148s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729688823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebe2879-2e68-4940-9d04-24514ddfe0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:27Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Creating volume 8ebe2879-2e68-4940-9d04-24514ddfe0a4 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:30 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8b39f2-d564-4cbb-8422-ace299166224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364cb478-6a08-41d2-866a-ddda1941dc2c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 1073741824
Nov 05 04:02:31 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d703cbbc-1dbf-4d87-a332-e7a74b26b353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume volume-364cb478-6a08-41d2-866a-ddda1941dc2c (364cb478-6a08-41d2-866a-ddda1941dc2c): created successfully
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d703cbbc-1dbf-4d87-a332-e7a74b26b353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (36261063-ddbe-47b2-8dcc-483b16c84d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-75bfcaa0-4ae4-43aa-bf27-d1d73a514cf1 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created volume successfully.
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Flow 'volume_create_manager' (410fc29d-a3a3-46e7-8114-99598d3cc8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d1ea90-0978-45e2-bd7d-9247e10dc661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d1ea90-0978-45e2-bd7d-9247e10dc661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1467001507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b13bc5-c6e1-431b-9c13-676ae6a5b46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abe5e960e8804cb59120b83717a6ac57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6a95ee3b-d3f4-4789-bf74-8fe4119c8e20,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:31Z,use_quota=True,user_id='c76b9c9106ed4ee4808bb9c75538194e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4fc72e-f848-4b9f-84d6-8a7cfb0e64ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4fc72e-f848-4b9f-84d6-8a7cfb0e64ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff068e30-df7a-4afe-b8a4-107ea8250df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff068e30-df7a-4afe-b8a4-107ea8250df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54b13bc5-c6e1-431b-9c13-676ae6a5b46a', 'volume_name': 'volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a', 'volume_size': 1, 'snapshot_id': '6a95ee3b-d3f4-4789-bf74-8fe4119c8e20'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6aa1e44-4d8e-44d9-95bf-a8148618e666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6aa1e44-4d8e-44d9-95bf-a8148618e666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2949422b-3f86-4459-b841-c3728ef2c17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Volume 54b13bc5-c6e1-431b-9c13-676ae6a5b46a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a', 'volume_size': 1, 'snapshot_id': '6a95ee3b-d3f4-4789-bf74-8fe4119c8e20'}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:31 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 1073741824" returned: 0 in 0.522s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:31 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4
Nov 05 04:02:31 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4" returned: 0 in 0.250s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.774s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587155126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3412719-ecb2-4a24-afa2-45eeb4d4f07d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:27Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Creating volume b3412719-ecb2-4a24-afa2-45eeb4d4f07d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:31 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ad63f2-dbe7-4388-856e-90fb9084d05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb3ac8d-7302-4740-a04e-7159fd491861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:31 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d 1073741824
Nov 05 04:02:31 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:31 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 (8ebe2879-2e68-4940-9d04-24514ddfe0a4): created successfully
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb3ac8d-7302-4740-a04e-7159fd491861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:31 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (88a0e038-18ad-4e19-8bfe-43d5e559aa29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:31 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-051aae83-a4c5-45be-b571-242cf0881962 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created volume successfully.
Nov 05 04:02:32 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d 1073741824" returned: 0 in 0.489s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d
Nov 05 04:02:32 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d" returned: 0 in 0.251s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.049s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1565560565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62938b5-58a0-44d2-9e72-1ac40d718665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:27Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Creating volume d62938b5-58a0-44d2-9e72-1ac40d718665 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:32 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:32 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665 1073741824
Nov 05 04:02:32 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367bf964-a634-496b-a2a9-c9ce1fb6b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5c31c7-07a1-4085-907c-344423c39091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:32 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d (b3412719-ecb2-4a24-afa2-45eeb4d4f07d): created successfully
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5c31c7-07a1-4085-907c-344423c39091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:32 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (0aa4f657-9eb7-484d-b267-6a796c933343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-27abecb3-1cb9-4162-88ae-f86a691a0fb3 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created volume successfully.
Nov 05 04:02:33 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665 1073741824" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665
Nov 05 04:02:33 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.397s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431822976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f5ef9a-de74-45ff-8c78-a997466f3804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62729d1b674b9daa2a4fbb956f8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:28Z,use_quota=True,user_id='5e5d8976e6894744a5907a7d223cb0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Creating volume 58f5ef9a-de74-45ff-8c78-a997466f3804 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804 1073741824
Nov 05 04:02:33 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b2c3505-c50d-44e8-be2e-138b7ec7d826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62938b5-58a0-44d2-9e72-1ac40d718665', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc63d96e-f1ae-4863-930f-12aff30291f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume volume-d62938b5-58a0-44d2-9e72-1ac40d718665 (d62938b5-58a0-44d2-9e72-1ac40d718665): created successfully
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc63d96e-f1ae-4863-930f-12aff30291f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (d90b3c5b-0912-4e73-acf3-d4554eb3191a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9ba6b6cc-8c4e-451f-b4cb-40f8b044b08b tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created volume successfully.
Nov 05 04:02:33 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804 1073741824" returned: 0 in 0.493s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:33 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804
Nov 05 04:02:33 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.181s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268962497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a01ac1-9a26-45e1-b011-27eb67343da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:29Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating volume 31a01ac1-9a26-45e1-b011-27eb67343da6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02be42a9-013a-454f-b06a-3b979dcef344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f5ef9a-de74-45ff-8c78-a997466f3804', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:34 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6 1073741824
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf355e4-677b-4acf-ac81-f9d2f40fff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:34 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Volume volume-58f5ef9a-de74-45ff-8c78-a997466f3804 (58f5ef9a-de74-45ff-8c78-a997466f3804): created successfully
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf355e4-677b-4acf-ac81-f9d2f40fff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Flow 'volume_create_manager' (49dec610-d4ec-4ef3-9d20-63d24f2ab87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b9526700-8f72-44a4-954f-e84e6c959cdd tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created volume successfully.
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-58f5ef9a-de74-45ff-8c78-a997466f3804-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-58f5ef9a-de74-45ff-8c78-a997466f3804-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:34 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6 1073741824" returned: 0 in 0.471s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-quobyte-58f5ef9a-de74-45ff-8c78-a997466f3804" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-58f5ef9a-de74-45ff-8c78-a997466f3804" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd080896-8e43-4c40-b05f-845369241789]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:34 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6
Nov 05 04:02:34 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:34 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804
Nov 05 04:02:34 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6" returned: 0 in 0.275s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.833s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0424af8-fae9-418b-b3c7-124e8b94d24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f469d1796d9b45e4a909b758fd0095a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:26Z,use_quota=True,user_id='d3254a1f892b4447b65562a0a6268d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d45a509c-9695-4fea-b439-82c2589f3a71),volume_type_id=d45a509c-9695-4fea-b439-82c2589f3a71)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Creating volume a0424af8-fae9-418b-b3c7-124e8b94d24e {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0314ef19-027e-4da9-8dd9-6daa1e1ecb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a01ac1-9a26-45e1-b011-27eb67343da6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:35 devstack sudo[107770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e 1073741824
Nov 05 04:02:35 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624c6b2c-2cfe-4db3-950b-b28ddd17662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume volume-31a01ac1-9a26-45e1-b011-27eb67343da6 (31a01ac1-9a26-45e1-b011-27eb67343da6): created successfully
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624c6b2c-2cfe-4db3-950b-b28ddd17662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (c1757af6-e02f-4b27-a681-b110f17fff32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1b2eb779-3d68-4d65-b069-f0147d3e52af tempest-CreateVolumesFromSnapshotTest-369974347 None] Created volume successfully.
Nov 05 04:02:35 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804
Nov 05 04:02:35 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-58f5ef9a-de74-45ff-8c78-a997466f3804" returned: 0 in 0.287s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-58f5ef9a-de74-45ff-8c78-a997466f3804" released by "delete_volume" :: held 0.755s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created reservations ['1ad8be51-ecc5-4aa5-a780-88128f1a56b6', '83d1146e-63e4-4297-91b0-69d56367f0af', 'd7a72496-c03e-4f94-a908-787b412459e4', '8ccc72dd-88a2-4bb8-912e-f56c277b5aaa'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:35 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e 1073741824" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e
Nov 05 04:02:35 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:35 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-d62938b5-58a0-44d2-9e72-1ac40d718665-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-d62938b5-58a0-44d2-9e72-1ac40d718665-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:35 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.481s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002002804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f29f29-ebe9-485b-8567-b8a68eba8a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:29Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating volume 96f29f29-ebe9-485b-8567-b8a68eba8a4d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:35 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:35 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d 1073741824
Nov 05 04:02:36 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Deleted volume successfully.
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Attempting download of df7a0fe5-c1a9-45eb-9900-8b62a895a2de ((None, [{'url': 'file:///opt/stack/data/glance/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'metadata': {}}])) to volume a0424af8-fae9-418b-b3c7-124e8b94d24e. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-quobyte-d62938b5-58a0-44d2-9e72-1ac40d718665" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c796a724-8fc1-49e0-89e8-7e24c9af508d tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-58f5ef9a-de74-45ff-8c78-a997466f3804-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-d62938b5-58a0-44d2-9e72-1ac40d718665" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eebd5b-2e55-48a6-aabc-fe726ab92fad]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3309245a-b065-458c-babb-99f77078792b]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665
Nov 05 04:02:36 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v
Nov 05 04:02:36 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d 1073741824" returned: 0 in 0.581s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665
Nov 05 04:02:36 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:36 devstack sudo[107805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d
Nov 05 04:02:36 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[107807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v
Nov 05 04:02:36 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:36 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-d62938b5-58a0-44d2-9e72-1ac40d718665" returned: 0 in 0.265s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-d62938b5-58a0-44d2-9e72-1ac40d718665" released by "delete_volume" :: held 0.776s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:36 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.130s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994533326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2d0e51-e70d-45ff-a8f8-56040f0b5584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:30Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating volume 1d2d0e51-e70d-45ff-a8f8-56040f0b5584 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:36 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03edf8ba-1cbf-4407-b138-1f5828173f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3ab623-ddeb-469a-ba64-8c0bf53b18c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:37 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 1073741824
Nov 05 04:02:37 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created reservations ['98f59697-ae34-48c8-aca9-173c7c86745b', '5c065ea6-92e4-4d11-8c59-2f3ca874376b', 'd2653c75-7d4d-4274-953f-28d4789d8d7d', '8b2c8d0e-d13c-4711-a2ea-a385b1d3ecc7'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:37 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d (96f29f29-ebe9-485b-8567-b8a68eba8a4d): created successfully
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3ab623-ddeb-469a-ba64-8c0bf53b18c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:37 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (6d3e1861-1c5f-4ad7-aef7-c690993b3da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v" returned: 1 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_z8evvd9v' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c007f8a-cd77-438d-a630-0088c3851bb8]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-04b0ef7d-dd30-41a8-b35b-4e0d1541e294 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created volume successfully.
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:37 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD
Nov 05 04:02:37 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Deleted volume successfully.
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2ae81b7-30db-4401-9775-5732229aa700 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-d62938b5-58a0-44d2-9e72-1ac40d718665-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:37 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 1073741824" returned: 0 in 0.650s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584
Nov 05 04:02:37 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD
Nov 05 04:02:37 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:37 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584" returned: 0 in 0.268s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.664s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640406808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d98ddcd-5416-414d-8f09-3c0e949dc6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:30Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating volume 6d98ddcd-5416-414d-8f09-3c0e949dc6a3 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:37 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:37 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:37 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098d98b1-556c-4b99-b1b7-070e7c215a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:38 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 1073741824
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76383c88-d6f5-4de1-858a-1f3532ab9ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:38 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] df7a0fe5-c1a9-45eb-9900-8b62a895a2de was raw, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 (1d2d0e51-e70d-45ff-a8f8-56040f0b5584): created successfully
Nov 05 04:02:38 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e
Nov 05 04:02:38 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76383c88-d6f5-4de1-858a-1f3532ab9ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (4073c3aa-9428-4037-95ed-62a884e69ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7f794aae-e2c7-4cbf-8913-9987b945364a tempest-CreateVolumesFromSnapshotTest-369974347 None] Created volume successfully.
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-b3412719-ecb2-4a24-afa2-45eeb4d4f07d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-b3412719-ecb2-4a24-afa2-45eeb4d4f07d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-quobyte-b3412719-ecb2-4a24-afa2-45eeb4d4f07d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-b3412719-ecb2-4a24-afa2-45eeb4d4f07d" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c5a1af-e7b6-4d58-8413-0069aa9bcdac]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d
Nov 05 04:02:38 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 1073741824" returned: 0 in 0.653s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3
Nov 05 04:02:38 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e" returned: 0 in 0.732s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df7a0fe5-c1a9-45eb-9900-8b62a895a2de_7yhv_cdzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:02:38 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e 1G
Nov 05 04:02:38 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d" returned: 0 in 0.497s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:38 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d
Nov 05 04:02:38 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:38 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.210s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240263941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6ac06b-e8fd-4990-8712-cdd410bdf921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c117ae374fab9aa78cc9e4cec447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:31Z,use_quota=True,user_id='b1d15060a7c44bada31a29c263f3cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Creating volume 6e6ac06b-e8fd-4990-8712-cdd410bdf921 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6351fa0e-f03a-442d-ad3d-c6d2192a7880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:39 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 1073741824
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6171584-dbbb-45d9-9ac9-8bd2ca685416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:39 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 (6d98ddcd-5416-414d-8f09-3c0e949dc6a3): created successfully
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6171584-dbbb-45d9-9ac9-8bd2ca685416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (ab138e67-22c1-4457-8527-26addc261af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0bb38fab-cb37-49e4-8c63-2b85ec884ca8 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created volume successfully.
Nov 05 04:02:39 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e 1G" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Downloaded image df7a0fe5-c1a9-45eb-9900-8b62a895a2de ((None, [{'url': 'file:///opt/stack/data/glance/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'metadata': {}}])) to volume a0424af8-fae9-418b-b3c7-124e8b94d24e successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Temporary image df7a0fe5-c1a9-45eb-9900-8b62a895a2de for user d3254a1f892b4447b65562a0a6268d55 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Marking volume a0424af8-fae9-418b-b3c7-124e8b94d24e as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:02:39 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b3412719-ecb2-4a24-afa2-45eeb4d4f07d" returned: 0 in 0.331s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Copying metadata from image df7a0fe5-c1a9-45eb-9900-8b62a895a2de to a0424af8-fae9-418b-b3c7-124e8b94d24e. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Creating volume glance metadata for volume a0424af8-fae9-418b-b3c7-124e8b94d24e backed by image df7a0fe5-c1a9-45eb-9900-8b62a895a2de with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e454c854f63d6a892d415beee1729d02', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-b3412719-ecb2-4a24-afa2-45eeb4d4f07d" released by "delete_volume" :: held 0.884s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created reservations ['0bdb08ab-f6a3-4246-b5cc-6deffb676c9c', '968983df-2bef-4326-82cb-a80449263f96', '4b700637-bb10-48d2-8a7b-cdeb00c1d295', '673571ea-ad06-479a-a727-b3ac620e2363'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dd9f79-9979-4f50-afa3-22aaa1766019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0424af8-fae9-418b-b3c7-124e8b94d24e', 'volume_size': 1, 'image_id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e454c854f63d6a892d415beee1729d02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f469d1796d9b45e4a909b758fd0095a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '938e1d177b25fb7074fcda4f07895252f6d822e143845621d9e7b2e6fb387b6574a6a258f3ba5c7a8aa92153e91e53ff52b947aea39021eabe2553cb9453cbe9', 'id': 'df7a0fe5-c1a9-45eb-9900-8b62a895a2de', 'created_at': datetime.datetime(2026, 11, 5, 3, 2, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 2, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df7a0fe5-c1a9-45eb-9900-8b62a895a2de/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72aec2ae0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b6c0cd-cd63-4503-83ac-38dabd2d4b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Volume volume-a0424af8-fae9-418b-b3c7-124e8b94d24e (a0424af8-fae9-418b-b3c7-124e8b94d24e): created successfully
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b6c0cd-cd63-4503-83ac-38dabd2d4b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Flow 'volume_create_manager' (ae84b7f5-f3dd-454f-b597-668f73a09a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e4ca7821-e4f8-4e79-aad0-16c940fa2fee tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Created volume successfully.
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:39 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 1073741824" returned: 0 in 0.606s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:39 devstack sudo[107871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921
Nov 05 04:02:39 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:39 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.294s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Deleted volume successfully.
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f22bc05c-fbea-485f-b085-2d5ffb89d311 tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-b3412719-ecb2-4a24-afa2-45eeb4d4f07d-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:39 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.604s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-quobyte-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf27811-6018-48ec-91f5-d40b8c2dc202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f054be6d-3840-4ebd-ab61-5562f18aab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Creating volume 54b13bc5-c6e1-431b-9c13-676ae6a5b46a from snapshot 6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-quobyte-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Volume volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 (6e6ac06b-e8fd-4990-8712-cdd410bdf921): created successfully
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f054be6d-3840-4ebd-ab61-5562f18aab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Flow 'volume_create_manager' (f14f4c2c-d418-4726-ae1e-1f65502ba829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] snapshot: 6a95ee3b-d3f4-4789-bf74-8fe4119c8e20, volume: 54b13bc5-c6e1-431b-9c13-676ae6a5b46a,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 04:02:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-79d59811-1ccd-4c64-9c5e-7c09c0e1d920 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created volume successfully.
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee23063-43ca-4d68-85e1-a216e0b0e2c5]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20
Nov 05 04:02:40 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Acquiring lock "cinder-a0424af8-fae9-418b-b3c7-124e8b94d24e-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-8ebe2879-2e68-4940-9d04-24514ddfe0a4-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "cinder-a0424af8-fae9-418b-b3c7-124e8b94d24e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8774197b-6c93-4944-b96e-d04e8d48f737]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-8ebe2879-2e68-4940-9d04-24514ddfe0a4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Acquiring lock "cinder-quobyte-a0424af8-fae9-418b-b3c7-124e8b94d24e" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-quobyte-8ebe2879-2e68-4940-9d04-24514ddfe0a4" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "cinder-quobyte-a0424af8-fae9-418b-b3c7-124e8b94d24e" acquired by "delete_volume" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-8ebe2879-2e68-4940-9d04-24514ddfe0a4" acquired by "delete_volume" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:40 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8
Nov 05 04:02:40 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b53c8f-e55e-4802-b4d6-0abdba19f6ac]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb214e8-d8f9-4641-9931-180a7408664e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-6e6ac06b-e8fd-4990-8712-cdd410bdf921-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-6e6ac06b-e8fd-4990-8712-cdd410bdf921-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-6e6ac06b-e8fd-4990-8712-cdd410bdf921" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:40 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4
Nov 05 04:02:40 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e
Nov 05 04:02:40 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6e6ac06b-e8fd-4990-8712-cdd410bdf921" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac004b26-9df9-47c6-b087-d718af740d4b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921
Nov 05 04:02:41 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" returned: 0 in 0.609s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[107892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a
Nov 05 04:02:41 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4" returned: 0 in 0.476s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e" returned: 0 in 0.524s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4
Nov 05 04:02:41 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e
Nov 05 04:02:41 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:41 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921
Nov 05 04:02:41 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:41 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8ebe2879-2e68-4940-9d04-24514ddfe0a4" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-8ebe2879-2e68-4940-9d04-24514ddfe0a4" released by "delete_volume" :: held 0.860s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-a0424af8-fae9-418b-b3c7-124e8b94d24e" returned: 0 in 0.311s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "cinder-quobyte-a0424af8-fae9-418b-b3c7-124e8b94d24e" released by "delete_volume" :: held 0.941s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created reservations ['d73876d7-5a6d-4674-baf7-27436e52beb6', 'd9a26c0f-cc7a-48b1-8ffe-5129ddf23e27', 'f697ac80-6116-4d00-b63a-fc41c94c50dd', '3ad8b2f9-2a4d-41ff-84eb-619e8d0db4af'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Created reservations ['3e6d66c2-cf57-47e9-914c-85d6968d92f1', '7876f7c2-597c-47a5-8e80-a088af413bee', '9192a877-f11f-42c4-a8bb-9809ddc502e5', '24ceb291-4e40-4c0a-be14-4dcc64c06290'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:41 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6e6ac06b-e8fd-4990-8712-cdd410bdf921" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6e6ac06b-e8fd-4990-8712-cdd410bdf921" released by "delete_volume" :: held 0.954s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:42 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:42 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['626ce1c1-e68b-4113-88c1-351c82b22da0', '27ea8fce-0167-49dd-b098-6050cf237b26', '46c5eba0-f048-441f-bd63-a686baf401df', '77299502-4a7c-49a4-b5fb-8da82d296eae'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:42 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:42 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:42 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:42 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:42 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Deleted volume successfully.
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9e2d91e1-1719-4081-80d9-7cb91ea8abec tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-8ebe2879-2e68-4940-9d04-24514ddfe0a4-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:42 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.673s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Deleted volume successfully.
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a30c20ac-4596-4180-9cab-8b4ffe8cdae8 tempest-VolumeAndVolumeTypeFromImageTest-1138931842 None] Lock "cinder-a0424af8-fae9-418b-b3c7-124e8b94d24e-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:42 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.596s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleted volume successfully.
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-364cb478-6a08-41d2-866a-ddda1941dc2c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-364cb478-6a08-41d2-866a-ddda1941dc2c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-43d6458d-45de-4416-a3a0-b9a59a690471 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-6e6ac06b-e8fd-4990-8712-cdd410bdf921-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-quobyte-364cb478-6a08-41d2-866a-ddda1941dc2c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-364cb478-6a08-41d2-866a-ddda1941dc2c" acquired by "delete_volume" :: waited 0.054s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cbd243-20f2-4695-820d-5b967b3e4107]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-6d98ddcd-5416-414d-8f09-3c0e949dc6a3-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-6d98ddcd-5416-414d-8f09-3c0e949dc6a3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:43 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c
Nov 05 04:02:43 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-6d98ddcd-5416-414d-8f09-3c0e949dc6a3" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6d98ddcd-5416-414d-8f09-3c0e949dc6a3" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c842327-4c28-4ff4-84c6-07a19a83f910]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3
Nov 05 04:02:44 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c" returned: 0 in 1.005s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c
Nov 05 04:02:44 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3" returned: 0 in 0.923s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:44 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-364cb478-6a08-41d2-866a-ddda1941dc2c" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:44 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3
Nov 05 04:02:44 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-364cb478-6a08-41d2-866a-ddda1941dc2c" released by "delete_volume" :: held 1.633s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created reservations ['6f80a42d-a7bd-40ee-8f33-9057707a5f2c', '05beb95c-d7ff-4bdd-b84e-3e8e62640d06', '6e04c8de-7a7d-472f-81f8-498020837aa2', '00b9de27-5cc9-47aa-a6c7-2a2845fca7ab'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:45 devstack sudo[107949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:45 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:45 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6d98ddcd-5416-414d-8f09-3c0e949dc6a3" returned: 0 in 0.598s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6d98ddcd-5416-414d-8f09-3c0e949dc6a3" released by "delete_volume" :: held 1.640s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['8c168fc7-8944-40e5-8016-4fe3c55e6eb6', '271f0d7d-b882-4f3c-9f9b-6189e53469a8', 'bb025091-926f-467c-b65e-1ddcc6586aa7', '71ce4163-888d-40f5-82a9-2757a6fc0f38'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-3a92a4e9-a7d6-4413-a134-57a2a29fcb47-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-3a92a4e9-a7d6-4413-a134-57a2a29fcb47-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.782s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-1d2d0e51-e70d-45ff-a8f8-56040f0b5584-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Deleted volume successfully.
Nov 05 04:02:46 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:46 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-1d2d0e51-e70d-45ff-a8f8-56040f0b5584-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "cinder-quobyte-3a92a4e9-a7d6-4413-a134-57a2a29fcb47" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b9b788ab-b01e-49bb-aae0-b95b62eb7e1f tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-364cb478-6a08-41d2-866a-ddda1941dc2c-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-3a92a4e9-a7d6-4413-a134-57a2a29fcb47" acquired by "delete_volume" :: waited 0.077s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcd6999-d3cc-4e52-a04e-edcbd569c720]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleted volume successfully.
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-1d2d0e51-e70d-45ff-a8f8-56040f0b5584" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9f3d09d8-c405-4936-b573-e718bb857d6f tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-6d98ddcd-5416-414d-8f09-3c0e949dc6a3-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-1d2d0e51-e70d-45ff-a8f8-56040f0b5584" acquired by "delete_volume" :: waited 0.120s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e295f6-d691-4069-937b-44c11d638c78]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:46 devstack sudo[107954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47
Nov 05 04:02:46 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:47 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584
Nov 05 04:02:47 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:47 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47" returned: 0 in 1.102s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:47 devstack sudo[107963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47
Nov 05 04:02:47 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:47 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584" returned: 0 in 1.201s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:47 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3a92a4e9-a7d6-4413-a134-57a2a29fcb47" returned: 0 in 0.556s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:48 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584
Nov 05 04:02:48 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-quobyte-3a92a4e9-a7d6-4413-a134-57a2a29fcb47" released by "delete_volume" :: held 1.799s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Created reservations ['f0d2a78e-49d7-4e8b-bc3c-d30ec800b79c', '7861653c-b133-4e35-a5d2-1e39e88520a1', '785c231f-4ef3-41a3-a246-af21b0070f74', 'd58968f7-93f8-4704-b30c-d14c68578f87'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:48 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:48 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1d2d0e51-e70d-45ff-a8f8-56040f0b5584" returned: 0 in 0.502s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:48 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-1d2d0e51-e70d-45ff-a8f8-56040f0b5584" released by "delete_volume" :: held 1.857s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['688d921b-1a51-4225-982d-1f849dcffe5b', 'fa554ee8-7c68-4ae7-ae40-4147182c7973', '2f4ed74a-c78d-4017-a272-3db6326b2c1a', '528a2f2d-5c78-4802-b59f-e9d15a257510'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:48 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.507s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Deleted volume successfully.
Nov 05 04:02:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ad2a0ec0-52fa-40fd-ba0d-b4a7563711af tempest-CreateVolumesFromSourceVolumeTest-1610081250 None] Lock "cinder-3a92a4e9-a7d6-4413-a134-57a2a29fcb47-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:49 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:49 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:49 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.528s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleted volume successfully.
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4bc6eee3-4c7e-40dd-83fb-2dd0a824ed9d tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-1d2d0e51-e70d-45ff-a8f8-56040f0b5584-delete_volume" released by "delete_volume" :: held 3.602s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-96f29f29-ebe9-485b-8567-b8a68eba8a4d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-96f29f29-ebe9-485b-8567-b8a68eba8a4d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-96f29f29-ebe9-485b-8567-b8a68eba8a4d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-96f29f29-ebe9-485b-8567-b8a68eba8a4d" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99916d0-e990-4220-ab20-418ca209a8c4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:50 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d
Nov 05 04:02:50 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:51 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d" returned: 0 in 1.150s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:51 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d
Nov 05 04:02:51 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:51 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" returned: 0 in 10.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8, size 1024.00 MB, duration 10.29 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:02:51 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Converted 1024.00 MB image at 99.48 MB/s
Nov 05 04:02:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a is being set with open permissions: ugo+rw
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:51 devstack sudo[107987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a
Nov 05 04:02:51 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:51 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-96f29f29-ebe9-485b-8567-b8a68eba8a4d" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-96f29f29-ebe9-485b-8567-b8a68eba8a4d" released by "delete_volume" :: held 1.618s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['5c984c0b-33c9-4f4c-aeab-28b2b950c7c7', '6fbd6700-94e9-4283-9df4-6203d6770005', '6d4f4d54-9510-454f-b5ec-e9166d374d23', 'b0b5c57e-e393-4fe3-98ad-cfc2a655589e'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:51 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" released by "_copy_volume_from_snapshot" :: held 11.821s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:51 devstack sudo[107991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:51 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" released by "_create_volume_from_snapshot" :: held 11.943s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.976s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2949422b-3f86-4459-b841-c3728ef2c17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a', 'volume_size': 1, 'snapshot_id': '6a95ee3b-d3f4-4789-bf74-8fe4119c8e20'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:51 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60af92c-a345-44dc-a966-4566be8c16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Volume volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a (54b13bc5-c6e1-431b-9c13-676ae6a5b46a): created successfully
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60af92c-a345-44dc-a966-4566be8c16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Flow 'volume_create_manager' (410fc29d-a3a3-46e7-8114-99598d3cc8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-21ed302c-93ff-4213-b4d7-faf4aaf81ade tempest-VolumeDependencyTests-677649469 None] Created volume successfully.
Nov 05 04:02:52 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.349s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleted volume successfully.
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-31a01ac1-9a26-45e1-b011-27eb67343da6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-31a01ac1-9a26-45e1-b011-27eb67343da6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d0e24cf4-b0f0-4170-9bf0-3586a1a292c9 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-96f29f29-ebe9-485b-8567-b8a68eba8a4d-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-31a01ac1-9a26-45e1-b011-27eb67343da6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-31a01ac1-9a26-45e1-b011-27eb67343da6" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceeecb8-a610-4bc0-8456-63e31d59e4cd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Lock "cinder-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-quobyte-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-quobyte-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Deleting offline snapshot 6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 of volume 376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] snapshot_file for this snap is: volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c901c0-541d-449d-8955-ffed9a848ff9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:52 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6
Nov 05 04:02:52 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:52 devstack sudo[107995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20
Nov 05 04:02:52 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6" returned: 0 in 0.599s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6
Nov 05 04:02:53 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3ae879-9a10-44e3-a93b-927a036ec02e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-31a01ac1-9a26-45e1-b011-27eb67343da6" returned: 0 in 0.410s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-31a01ac1-9a26-45e1-b011-27eb67343da6" released by "delete_volume" :: held 1.087s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:53 devstack sudo[108006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8
Nov 05 04:02:53 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['3aaddce3-3905-43ca-94a6-b303d3ad2775', '0eb7bbbf-9efb-49f1-82f5-72d4d826e034', '034567d8-7339-4d2f-be39-1d3b7b308bf1', '83cebc88-4d9b-414f-aa33-249254bffb53'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (64505eee-5106-446c-9edb-04e9f5b58753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52a386-b87f-42ac-9dce-2e4550be3be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:53 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:53 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb52a386-b87f-42ac-9dce-2e4550be3be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-961082422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd45e68-994e-40e0-b8c9-811ed6de9374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:54Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda8db75-c2dd-45f4-878b-cd3bce103269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda8db75-c2dd-45f4-878b-cd3bce103269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1ad204-dfe2-4327-8255-612f7ac2a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1ad204-dfe2-4327-8255-612f7ac2a498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd45e68-994e-40e0-b8c9-811ed6de9374', 'volume_name': 'volume-0bd45e68-994e-40e0-b8c9-811ed6de9374', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792d5d18-0578-4eaf-8fdc-c21060142c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792d5d18-0578-4eaf-8fdc-c21060142c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbe600b-c1f9-4e22-abdd-c20cb587b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Volume 0bd45e68-994e-40e0-b8c9-811ed6de9374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd45e68-994e-40e0-b8c9-811ed6de9374', 'volume_size': 1}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-961082422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd45e68-994e-40e0-b8c9-811ed6de9374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:54Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Creating volume 0bd45e68-994e-40e0-b8c9-811ed6de9374 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:53 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:53 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 1073741824
Nov 05 04:02:53 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:54 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleted volume successfully.
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1328a9d9-c38f-4b9c-964f-75ca3dc1ea34 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-31a01ac1-9a26-45e1-b011-27eb67343da6-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:54 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" returned: 0 in 1.040s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack sudo[108022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20
Nov 05 04:02:54 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (d96212e3-00e9-4dfb-a56c-16c4353e538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:54 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b16b276-8af1-4c3c-8e5b-9857f8416001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 1073741824" returned: 0 in 0.756s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b16b276-8af1-4c3c-8e5b-9857f8416001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803180560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ddde71-0337-4a58-a098-c7c427b33313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:54Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9960423-9b10-45f9-b1ab-bce48bbbbfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9960423-9b10-45f9-b1ab-bce48bbbbfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5eab25f-0014-4970-9de2-51f43ad16164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5eab25f-0014-4970-9de2-51f43ad16164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ddde71-0337-4a58-a098-c7c427b33313', 'volume_name': 'volume-53ddde71-0337-4a58-a098-c7c427b33313', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb79b7c5-ae3e-428c-8d72-be70f2b71ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb79b7c5-ae3e-428c-8d72-be70f2b71ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40005fc-eed8-4fd9-941f-a1e541b0f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:54 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Volume 53ddde71-0337-4a58-a098-c7c427b33313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ddde71-0337-4a58-a098-c7c427b33313', 'volume_size': 1}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-6f599a5b-bde0-4b1b-b590-492266fc713c" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6f599a5b-bde0-4b1b-b590-492266fc713c" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:54 devstack sudo[108033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374
Nov 05 04:02:54 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Flow 'volume_create_manager' (c6c25c53-f83c-4d31-a5bd-e9b7094918e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:55 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60dd04e-eb2f-4036-baee-385a46a169a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" acquired by "_delete_snapshot" :: waited 0.105s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleting offline snapshot 9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f of volume 6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] snapshot_file for this snap is: volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" returned: 0 in 0.802s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60dd04e-eb2f-4036-baee-385a46a169a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d95824-45d6-4888-a00d-d1dacfcb21f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ea09583c6044feb8dee02e0925ec3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:55Z,use_quota=True,user_id='acc3f448a8f54163b83040ef6cddf0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d6bcd8-f7c5-4d14-8a6a-bc74efd68682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d6bcd8-f7c5-4d14-8a6a-bc74efd68682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b0dd41-72f3-449f-8872-24eabe91d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b0dd41-72f3-449f-8872-24eabe91d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d95824-45d6-4888-a00d-d1dacfcb21f0', 'volume_name': 'volume-27d95824-45d6-4888-a00d-d1dacfcb21f0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack sudo[108035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20
Nov 05 04:02:55 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba9b44f-b0ad-4bd1-be51-dfa17c6a15e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba9b44f-b0ad-4bd1-be51-dfa17c6a15e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4cafd0-14a4-4cc7-b72d-57c5f5590417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Volume 27d95824-45d6-4888-a00d-d1dacfcb21f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d95824-45d6-4888-a00d-d1dacfcb21f0', 'volume_size': 1}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bbb633-efc6-4fea-8ce9-a0e5f225b515]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (5766b674-cc1f-479f-a2dd-c841a1df1589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920fcf64-ab96-4a2b-bf8f-3403fdd53057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920fcf64-ab96-4a2b-bf8f-3403fdd53057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401078406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2f1739-c2ec-4caa-be30-41a00fd8d5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:55Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae835a1a-606b-4966-8b52-8c46014251ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae835a1a-606b-4966-8b52-8c46014251ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863d156-54c4-4fe9-afd8-d94b741baea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863d156-54c4-4fe9-afd8-d94b741baea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2f1739-c2ec-4caa-be30-41a00fd8d5a0', 'volume_name': 'volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:55 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f
Nov 05 04:02:55 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d09a17-93e6-46f1-ad6b-b00e9a660893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d09a17-93e6-46f1-ad6b-b00e9a660893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1338c345-8853-4053-afc5-ce046442d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Volume dc2f1739-c2ec-4caa-be30-41a00fd8d5a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0', 'volume_size': 1}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1803180560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ddde71-0337-4a58-a098-c7c427b33313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:54Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Creating volume 53ddde71-0337-4a58-a098-c7c427b33313 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbe600b-c1f9-4e22-abdd-c20cb587b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd45e68-994e-40e0-b8c9-811ed6de9374', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack sudo[108040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313 1073741824
Nov 05 04:02:55 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7453e760-4582-4027-bbf1-5f2be12a17d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Volume volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 (0bd45e68-994e-40e0-b8c9-811ed6de9374): created successfully
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7453e760-4582-4027-bbf1-5f2be12a17d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (64505eee-5106-446c-9edb-04e9f5b58753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-180b3c6c-d4a6-40c7-91f3-4b28c4a83903 tempest-CreateVolumesFromImageTest-2008615673 None] Created volume successfully.
Nov 05 04:02:55 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8.6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20" released by "_delete_snapshot" :: held 3.071s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" released by "delete_snapshot" :: held 3.130s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (ac9b9be2-cd5d-48ab-bdc2-ee804b699607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9091b9e7-eaaa-42ce-a6ac-43238b5dc8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9091b9e7-eaaa-42ce-a6ac-43238b5dc8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854318111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e5be71-0b1d-4940-a0e0-a5d711daec24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:56Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92871c4-b5bd-457a-8642-5d8f25c004f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92871c4-b5bd-457a-8642-5d8f25c004f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea6bead-b1a0-477d-a2f3-baf4c4e467be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea6bead-b1a0-477d-a2f3-baf4c4e467be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e5be71-0b1d-4940-a0e0-a5d711daec24', 'volume_name': 'volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d203442e-7f9a-42e4-9389-21fc163bf541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d203442e-7f9a-42e4-9389-21fc163bf541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c13d297-c079-45f0-8a27-4c7fa0b2b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Volume b7e5be71-0b1d-4940-a0e0-a5d711daec24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24', 'volume_size': 1}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" returned: 0 in 0.624s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f599a5b-bde0-4b1b-b590-492266fc713c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cce80b-f88f-4ff5-964a-252e2b52dd3e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Created reservations ['74b10681-d253-47a7-9ce4-b3a0146be056', '451ad2c1-af1b-49d7-8fa6-0c70eb04d148', 'e8c5fa7a-a142-4139-960f-f9218b387946', 'a589b984-f5fb-4218-8e36-c81dfed5af07'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Delete snapshot completed successfully.
Nov 05 04:02:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f8180faf-093d-4cb5-a11e-520c511d1dff tempest-VolumeDependencyTests-677649469 None] Lock "cinder-6a95ee3b-d3f4-4789-bf74-8fe4119c8e20-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:56 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c
Nov 05 04:02:56 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313 1073741824" returned: 0 in 0.681s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313
Nov 05 04:02:56 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (d6521fa2-9435-4923-bf5c-107dfa1c7862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7fe9e7-2e57-490c-86f8-4a6044df6796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7fe9e7-2e57-490c-86f8-4a6044df6796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101510108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cd4d7a-84f6-4ba3-a047-d28cc9dc345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:56Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad6c2d3-c76c-453e-94eb-f1b379cdf19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad6c2d3-c76c-453e-94eb-f1b379cdf19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7f90aa-ed1a-4ef9-8984-a4b51e2d38d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7f90aa-ed1a-4ef9-8984-a4b51e2d38d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cd4d7a-84f6-4ba3-a047-d28cc9dc345b', 'volume_name': 'volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06657c3d-62f9-4db3-9dfa-7dddc87cd094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06657c3d-62f9-4db3-9dfa-7dddc87cd094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b746c7-603e-4986-acc2-37b5451ac627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Volume 48cd4d7a-84f6-4ba3-a047-d28cc9dc345b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b', 'volume_size': 1}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c" returned: 0 in 0.506s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f
Nov 05 04:02:56 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.250s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d95824-45d6-4888-a00d-d1dacfcb21f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ea09583c6044feb8dee02e0925ec3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:55Z,use_quota=True,user_id='acc3f448a8f54163b83040ef6cddf0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Creating volume 27d95824-45d6-4888-a00d-d1dacfcb21f0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40005fc-eed8-4fd9-941f-a1e541b0f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ddde71-0337-4a58-a098-c7c427b33313', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 1073741824
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b3e3a4-6b9b-49cf-996a-57cd6d43253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:56 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Volume volume-53ddde71-0337-4a58-a098-c7c427b33313 (53ddde71-0337-4a58-a098-c7c427b33313): created successfully
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b3e3a4-6b9b-49cf-996a-57cd6d43253f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (d96212e3-00e9-4dfb-a56c-16c4353e538f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1ca39a76-dc1d-461a-a69c-81c748507a67 tempest-CreateVolumesFromImageTest-2008615673 None] Created volume successfully.
Nov 05 04:02:56 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" returned: 0 in 0.370s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:56 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f
Nov 05 04:02:56 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:56 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 1073741824" returned: 0 in 0.517s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:57 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0
Nov 05 04:02:57 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c.9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f" released by "_delete_snapshot" :: held 2.057s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6f599a5b-bde0-4b1b-b590-492266fc713c" released by "delete_snapshot" :: held 2.175s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-quobyte-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf2b68-bb29-4595-89e5-fed656dc397a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['9bffbd72-b824-49a7-9eba-ac89f2691413', '9c82c07e-b680-42ff-a249-b11c6e39607c', 'bccea63b-2a1c-4446-ab3e-a762f78f92dc', '8559c672-2654-4d3d-82ad-7d3ff0610a09'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:57 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0" returned: 0 in 0.340s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:57 devstack sudo[108075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401078406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2f1739-c2ec-4caa-be30-41a00fd8d5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:55Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:57 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Creating volume dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:57 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4cafd0-14a4-4cc7-b72d-57c5f5590417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d95824-45d6-4888-a00d-d1dacfcb21f0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769c0785-9978-4163-86b4-bf69cc52489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:57 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 1073741824
Nov 05 04:02:57 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Delete snapshot completed successfully.
Nov 05 04:02:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Volume volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 (27d95824-45d6-4888-a00d-d1dacfcb21f0): created successfully
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769c0785-9978-4163-86b4-bf69cc52489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Flow 'volume_create_manager' (c6c25c53-f83c-4d31-a5bd-e9b7094918e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4ea434c1-6271-4e70-b193-bccdac5d9d10 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-9de142ff-aa2b-4a6a-a56a-5ee0e2a9260f-delete_snapshot" released by "delete_snapshot" :: held 2.554s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-83ead35a-f49f-4853-a06d-9050335afaac tempest-CinderUnicodeTest-261639694 None] Created volume successfully.
Nov 05 04:02:57 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" returned: 0 in 0.441s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8
Nov 05 04:02:57 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:57 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 1073741824" returned: 0 in 0.490s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:57 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0
Nov 05 04:02:57 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" returned: 0 in 0.346s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8" released by "delete_volume" :: held 0.872s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-6f599a5b-bde0-4b1b-b590-492266fc713c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-6f599a5b-bde0-4b1b-b590-492266fc713c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Created reservations ['20bcb858-b7e2-466e-bab9-6cbbd591cc2f', 'e98cf970-dba7-4ccf-89dc-d0f5eb77a3da', 'ebc29686-dacf-4886-9f60-7b178f6e5efd', '1f838c64-1f8b-488a-9fab-18d31ec44f47'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "cinder-quobyte-6f599a5b-bde0-4b1b-b590-492266fc713c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6f599a5b-bde0-4b1b-b590-492266fc713c" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:58 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de99f20-8b94-49b9-a4ac-c229d3b28dca]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854318111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e5be71-0b1d-4940-a0e0-a5d711daec24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:56Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Creating volume b7e5be71-0b1d-4940-a0e0-a5d711daec24 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:58 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack sudo[108094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 1073741824
Nov 05 04:02:58 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1338c345-8853-4053-afc5-ce046442d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f55811-59b3-4ff9-b591-646a9638ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Volume volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 (dc2f1739-c2ec-4caa-be30-41a00fd8d5a0): created successfully
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f55811-59b3-4ff9-b591-646a9638ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (5766b674-cc1f-479f-a2dd-c841a1df1589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:58 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:58 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ef6990a3-bdad-4f4e-b06c-98cf8082ffb4 tempest-CreateVolumesFromImageTest-2008615673 None] Created volume successfully.
Nov 05 04:02:58 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c
Nov 05 04:02:58 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Flow 'volume_create_manager' (a0b41696-7a13-4502-aa45-fe23ab209a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bef122c-6ea1-4c01-b7d0-f7e560a8194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bef122c-6ea1-4c01-b7d0-f7e560a8194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-499482980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3851992f-397e-42b9-ad16-49f76c8804d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ea09583c6044feb8dee02e0925ec3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:59Z,use_quota=True,user_id='acc3f448a8f54163b83040ef6cddf0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dd7f9c-da76-40d0-8221-78b1c60671b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dd7f9c-da76-40d0-8221-78b1c60671b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74552e6-9dd1-4fc2-bdfc-ff09ab1ee066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74552e6-9dd1-4fc2-bdfc-ff09ab1ee066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3851992f-397e-42b9-ad16-49f76c8804d0', 'volume_name': 'volume-3851992f-397e-42b9-ad16-49f76c8804d0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d84c2eb-c8bb-493c-84e6-cd4a3e595e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d84c2eb-c8bb-493c-84e6-cd4a3e595e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fb80d4-4311-4400-bc7b-b0f1ea889de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Volume 3851992f-397e-42b9-ad16-49f76c8804d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3851992f-397e-42b9-ad16-49f76c8804d0', 'volume_size': 1}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Deleted volume successfully.
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c" returned: 0 in 0.579s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-beba3c16-fef5-45f5-960c-7b45d2e74119 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-376dd2d2-c8fd-4d29-bed4-56e133b1d9e8-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:58 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c
Nov 05 04:02:58 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 1073741824" returned: 0 in 0.660s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24
Nov 05 04:02:59 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6f599a5b-bde0-4b1b-b590-492266fc713c" returned: 0 in 0.324s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-quobyte-6f599a5b-bde0-4b1b-b590-492266fc713c" released by "delete_volume" :: held 1.025s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:02:59 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24" returned: 0 in 0.289s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101510108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cd4d7a-84f6-4ba3-a047-d28cc9dc345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9bbdaba7004145bdf39f6d7be0243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:56Z,use_quota=True,user_id='5899088663fb415ba5a43630e3adeab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Creating volume 48cd4d7a-84f6-4ba3-a047-d28cc9dc345b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:02:59 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b 1073741824
Nov 05 04:02:59 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-54b13bc5-c6e1-431b-9c13-676ae6a5b46a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c13d297-c079-45f0-8a27-4c7fa0b2b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f7dc59-9501-4701-b03f-0ee50506de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-54b13bc5-c6e1-431b-9c13-676ae6a5b46a-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Created reservations ['5deb107b-27d6-4f7d-81d5-91e1c9934e59', '9ad4f4cc-4c48-4f5a-9f87-917520d9f576', 'fffd2fa4-69cc-4996-bc2a-dc964b88874a', '5bdbc4b6-9650-4632-bb09-01fd417f2625'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:02:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Volume volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 (b7e5be71-0b1d-4940-a0e0-a5d711daec24): created successfully
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f7dc59-9501-4701-b03f-0ee50506de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (ac9b9be2-cd5d-48ab-bdc2-ee804b699607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:02:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2a22b69e-4016-49a5-b8c1-eee28a6273bd tempest-CreateVolumesFromImageTest-2008615673 None] Created volume successfully.
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Acquiring lock "cinder-quobyte-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42adc4-57e9-4c36-9e39-92e810892b5e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:02:59 devstack sudo[108119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:02:59 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a
Nov 05 04:02:59 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:02:59 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Nov 05 04:02:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b 1073741824" returned: 0 in 0.627s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:00 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Deleted volume successfully.
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-655e180a-b44c-43f7-96dd-928013120b93 tempest-CreateVolumesFromSnapshotTest-369974347 None] Lock "cinder-6f599a5b-bde0-4b1b-b590-492266fc713c-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:00 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" returned: 0 in 0.500s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a
Nov 05 04:03:00 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:02:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-499482980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3851992f-397e-42b9-ad16-49f76c8804d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ea09583c6044feb8dee02e0925ec3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:59Z,use_quota=True,user_id='acc3f448a8f54163b83040ef6cddf0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Creating volume 3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:00 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b746c7-603e-4986-acc2-37b5451ac627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbedf3fc-c3c3-4a16-85b6-d6c067fdca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:00 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 1073741824
Nov 05 04:03:00 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Volume volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b (48cd4d7a-84f6-4ba3-a047-d28cc9dc345b): created successfully
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbedf3fc-c3c3-4a16-85b6-d6c067fdca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Flow 'volume_create_manager' (d6521fa2-9435-4923-bf5c-107dfa1c7862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e7b32f8c-b46d-4895-8775-f6f470f71809 tempest-CreateVolumesFromImageTest-2008615673 None] Created volume successfully.
Nov 05 04:03:00 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-quobyte-54b13bc5-c6e1-431b-9c13-676ae6a5b46a" released by "delete_volume" :: held 0.907s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Created reservations ['42024be9-1d57-44f8-9137-c61289540cf7', '2a2dde21-cbe9-4fc7-8f4f-a31ca13dc543', 'aedd25cf-463e-44a9-a0fd-ecc6cd881f5f', 'bba403ff-c063-43fa-baa3-7dacd466098f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:00 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:00 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:00 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 1073741824" returned: 0 in 0.653s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0
Nov 05 04:03:01 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:01 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.536s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Deleted volume successfully.
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-quobyte-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7a87bdae-a97c-4a75-8746-f3e982f1e6a2 tempest-VolumeDependencyTests-677649469 None] Lock "cinder-54b13bc5-c6e1-431b-9c13-676ae6a5b46a-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[69709766-e56a-423e-964d-a373eb3b20df]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0" returned: 0 in 0.417s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fb80d4-4311-4400-bc7b-b0f1ea889de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3851992f-397e-42b9-ad16-49f76c8804d0', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3540dc02-540e-401a-835f-0989c74d255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:01 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b
Nov 05 04:03:01 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:01 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Volume volume-3851992f-397e-42b9-ad16-49f76c8804d0 (3851992f-397e-42b9-ad16-49f76c8804d0): created successfully
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3540dc02-540e-401a-835f-0989c74d255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Flow 'volume_create_manager' (a0b41696-7a13-4502-aa45-fe23ab209a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-30453b44-dd5b-4814-a32d-aa5161d223b4 tempest-CinderUnicodeTest-261639694 None] Created volume successfully.
Nov 05 04:03:01 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:01 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b
Nov 05 04:03:01 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b" returned: 0 in 0.326s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b" released by "delete_volume" :: held 0.893s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Created reservations ['fa34cfb9-7448-4855-9a40-ab15c52d554a', 'f5d279e7-3e6e-4236-8208-1cb06e4f8372', '597944cd-f0fb-407f-bd55-cde29ece29a0', 'c2460af0-6a8f-465b-9e2c-0b3e493824bc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:02 devstack sudo[108193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:02 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Creating offline snapshot b55744cd-a757-4c18-a359-839cf5299f84 of volume 3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8906df9b-1764-4432-bc57-3bccd76655ce]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:02 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0
Nov 05 04:03:02 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:02 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Deleted volume successfully.
Nov 05 04:03:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a2aafe27-af5b-472e-a2ae-a14ba168e70f tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-48cd4d7a-84f6-4ba3-a047-d28cc9dc345b-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:03 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0" returned: 0 in 0.508s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 1G
Nov 05 04:03:03 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-b7e5be71-0b1d-4940-a0e0-a5d711daec24-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-b7e5be71-0b1d-4940-a0e0-a5d711daec24-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-quobyte-b7e5be71-0b1d-4940-a0e0-a5d711daec24" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-b7e5be71-0b1d-4940-a0e0-a5d711daec24" acquired by "delete_volume" :: waited 0.029s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bddeded-2108-4fca-8af9-2d559621cc16]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 1G" returned: 0 in 0.648s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3851992f-397e-42b9-ad16-49f76c8804d0 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:03 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3851992f-397e-42b9-ad16-49f76c8804d0 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84
Nov 05 04:03:03 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:03 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24
Nov 05 04:03:03 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3851992f-397e-42b9-ad16-49f76c8804d0 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 is being set with open permissions: ugo+rw
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24
Nov 05 04:03:04 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84
Nov 05 04:03:04 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-b7e5be71-0b1d-4940-a0e0-a5d711daec24" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-b7e5be71-0b1d-4940-a0e0-a5d711daec24" released by "delete_volume" :: held 0.876s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info
Nov 05 04:03:04 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Created reservations ['dd76f035-efca-4a7a-825c-572da4bae45a', 'fcde4153-bc34-4550-a47e-edcd557e4304', '73e00c16-e4a0-4286-ab6e-9947610472cb', 'a42a245e-7687-4c5b-9aea-6f790d013061'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:04 devstack sudo[108233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:04 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:05 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info" returned: 0 in 0.414s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:05 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info is being set with open permissions: ugo+rw
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:05 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info
Nov 05 04:03:05 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:05 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Deleted volume successfully.
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-76353df5-6894-4d36-8e8a-b7ee9d4b1ef7 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-b7e5be71-0b1d-4940-a0e0-a5d711daec24-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:05 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.info" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fc8360bc-8cc2-4a02-998b-b87c64a87e5b tempest-CinderUnicodeTest-261639694 None] Create snapshot completed successfully
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-b55744cd-a757-4c18-a359-839cf5299f84-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Lock "cinder-b55744cd-a757-4c18-a359-839cf5299f84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-quobyte-3851992f-397e-42b9-ad16-49f76c8804d0" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-3851992f-397e-42b9-ad16-49f76c8804d0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-quobyte-b55744cd-a757-4c18-a359-839cf5299f84" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-b55744cd-a757-4c18-a359-839cf5299f84" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Deleting offline snapshot b55744cd-a757-4c18-a359-839cf5299f84 of volume 3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] snapshot_file for this snap is: volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18d641f-a553-45f4-8619-7e166e274c09]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-quobyte-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbda615-41a5-4708-b455-52aae7b0d74b]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:06 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84
Nov 05 04:03:06 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:06 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0
Nov 05 04:03:06 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:06 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84" returned: 0 in 0.457s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3851992f-397e-42b9-ad16-49f76c8804d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[569c5d31-86db-4279-8470-22ab7f627657]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:06 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0" returned: 0 in 0.445s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:06 devstack sudo[108251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0
Nov 05 04:03:06 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:06 devstack sudo[108250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0
Nov 05 04:03:06 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:06 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0" released by "delete_volume" :: held 0.839s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Created reservations ['1eff2e9c-f6c0-42b7-a6a9-2aa9896031b0', '660f8adb-4556-4de1-a1e7-89a01918c0b2', '07d2747f-8464-4cbe-8e0c-e69294544d6d', 'a1c35d07-af4f-4947-abf0-064b33403900'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:07 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0" returned: 0 in 0.545s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:07 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84
Nov 05 04:03:07 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:07 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:07 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:07 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.367s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Deleted volume successfully.
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-81ab21ab-c88d-4d0d-9944-dc33e1acf410 tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-dc2f1739-c2ec-4caa-be30-41a00fd8d5a0-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:07 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84" returned: 0 in 0.540s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:07 devstack sudo[108268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84
Nov 05 04:03:07 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:07 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0.b55744cd-a757-4c18-a359-839cf5299f84" returned: 0 in 0.288s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-b55744cd-a757-4c18-a359-839cf5299f84" released by "_delete_snapshot" :: held 2.000s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-3851992f-397e-42b9-ad16-49f76c8804d0" released by "delete_snapshot" :: held 2.031s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Created reservations ['3d2aca0f-47f8-4a6f-b253-a3e62433379e', 'ee29ed5b-72eb-4575-afa2-d2b7b9588f18', 'd72fceec-75ac-41aa-b2e1-a4a66a2db8b9', 'd3693b92-2e72-449f-982a-b1a74b0ac5ab'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:08 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Delete snapshot completed successfully.
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-a08f0bad-703f-4652-80fb-075963fc4cd4 tempest-CinderUnicodeTest-261639694 None] Lock "cinder-b55744cd-a757-4c18-a359-839cf5299f84-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-53ddde71-0337-4a58-a098-c7c427b33313-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-53ddde71-0337-4a58-a098-c7c427b33313-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-quobyte-53ddde71-0337-4a58-a098-c7c427b33313" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-53ddde71-0337-4a58-a098-c7c427b33313" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba7b024-ac8a-4263-8431-bfa5e3a13194]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[108272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313
Nov 05 04:03:08 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:08 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:08 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:08 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313
Nov 05 04:03:08 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:09 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-3851992f-397e-42b9-ad16-49f76c8804d0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Lock "cinder-3851992f-397e-42b9-ad16-49f76c8804d0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:09 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-53ddde71-0337-4a58-a098-c7c427b33313" returned: 0 in 0.414s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-53ddde71-0337-4a58-a098-c7c427b33313" released by "delete_volume" :: held 0.959s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-quobyte-3851992f-397e-42b9-ad16-49f76c8804d0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Flow 'volume_create_manager' (93a7345c-339b-43b8-b9ab-9153660ab37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbed442-acc1-4c6c-88e4-05ec2206dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-3851992f-397e-42b9-ad16-49f76c8804d0" acquired by "delete_volume" :: waited 0.058s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbed442-acc1-4c6c-88e4-05ec2206dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb2e7df-94fa-4fdf-b71a-844905394ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51b901d2caa4512b21785066bf42f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:09Z,use_quota=True,user_id='965cb2e65cbb4e87ac28f3d69ca0aaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293e94b0-4b97-4a45-8d3c-96d5c80b7031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293e94b0-4b97-4a45-8d3c-96d5c80b7031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329cd98d-ec89-4e16-a06e-62757e1ec914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.image.glance [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Creating Keystone auth plugin from conf {{(pid=87098) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b4ccf7-a3ad-4e86-8bbe-dada530e1592]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Created reservations ['e8e6688b-9c57-497d-8fd6-aba07f65d0dd', 'ba10155f-4c63-4097-96e5-293c15041981', 'e267d63b-7cff-4d84-a8aa-78bbe4216041', '1cf10ca1-5ef7-4d2b-baf5-215e06b3a4dc'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:09 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0
Nov 05 04:03:09 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:09 devstack sudo[108286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:09 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329cd98d-ec89-4e16-a06e-62757e1ec914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbb2e7df-94fa-4fdf-b71a-844905394ccc', 'volume_name': 'volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc', 'volume_size': 1, 'image_id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3ce8e7af99df44d528af9fe2e408d41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a51b901d2caa4512b21785066bf42f8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfcc6cb3f04db854b0e164ec87385b94bfebc676a7a9b4b80013a2db145cb987282962534f5cae2178d43a5cfd58711f824c590c9abc4e55de6a3cef19349f37', 'id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'created_at': datetime.datetime(2026, 11, 5, 3, 3, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 3, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72ae3c3b0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1152db9-a7cb-411d-8b57-f4677a7a3190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1152db9-a7cb-411d-8b57-f4677a7a3190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d65f4d-d0b2-48ef-b0c9-5ba56d6be53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:09 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Volume dbb2e7df-94fa-4fdf-b71a-844905394ccc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc', 'volume_size': 1, 'image_id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3ce8e7af99df44d528af9fe2e408d41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a51b901d2caa4512b21785066bf42f8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfcc6cb3f04db854b0e164ec87385b94bfebc676a7a9b4b80013a2db145cb987282962534f5cae2178d43a5cfd58711f824c590c9abc4e55de6a3cef19349f37', 'id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'created_at': datetime.datetime(2026, 11, 5, 3, 3, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 3, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72ae3c3b0>}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Trying to clone dbb2e7df-94fa-4fdf-b71a-844905394ccc from image 4db3a0d6-a14e-4320-85ff-62d42bef16c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'metadata': {}}]). {{(pid=87098) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:03:09 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0" returned: 0 in 0.520s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.371s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Nov 05 04:03:10 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:03:10 devstack sudo[108293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0
Nov 05 04:03:10 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Deleted volume successfully.
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7cca87f2-7c8d-45fb-8860-7899e1e1292c tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-53ddde71-0337-4a58-a098-c7c427b33313-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e48d898-0d33-497a-a612-01c66bb1f13b]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack sudo[108295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD
Nov 05 04:03:10 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3851992f-397e-42b9-ad16-49f76c8804d0" returned: 0 in 0.335s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-3851992f-397e-42b9-ad16-49f76c8804d0" released by "delete_volume" :: held 0.954s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Created reservations ['34e46753-574f-4939-b7e4-c334920ebcf4', '7b1ac580-97db-4437-85d0-16a7b8fe34d4', 'b395050e-8364-4ad7-b909-25d5271cc9f1', '3063a772-4edc-4118-b8c9-9240974db8f4'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:10 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-0bd45e68-994e-40e0-b8c9-811ed6de9374-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-0bd45e68-994e-40e0-b8c9-811ed6de9374-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:10 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:10 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD
Nov 05 04:03:10 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "cinder-quobyte-0bd45e68-994e-40e0-b8c9-811ed6de9374" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-0bd45e68-994e-40e0-b8c9-811ed6de9374" acquired by "delete_volume" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0553886-c568-4eb5-9559-a1776a0bdd80]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:10 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374
Nov 05 04:03:10 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:10 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Deleted volume successfully.
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fe319c0b-3c55-4cae-8a56-f3eead2ad9ac tempest-CinderUnicodeTest-261639694 None] Lock "cinder-3851992f-397e-42b9-ad16-49f76c8804d0-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:10 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:03:10 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Temporary image 4db3a0d6-a14e-4320-85ff-62d42bef16c7 is fetched for user 965cb2e65cbb4e87ac28f3d69ca0aaf3. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd81c29-fc8c-47e0-a352-b6232d3bb591]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD
Nov 05 04:03:11 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374" returned: 0 in 0.475s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374
Nov 05 04:03:11 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-27d95824-45d6-4888-a00d-d1dacfcb21f0-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:11 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0bd45e68-994e-40e0-b8c9-811ed6de9374" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-quobyte-0bd45e68-994e-40e0-b8c9-811ed6de9374" released by "delete_volume" :: held 0.872s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Lock "cinder-27d95824-45d6-4888-a00d-d1dacfcb21f0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:11 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD
Nov 05 04:03:11 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Acquiring lock "cinder-quobyte-27d95824-45d6-4888-a00d-d1dacfcb21f0" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-27d95824-45d6-4888-a00d-d1dacfcb21f0" acquired by "delete_volume" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Created reservations ['e1450964-58de-4e1e-8d6f-3ed1b99d7f94', '66c64546-ce9c-43be-9ac5-58a692fa0ea3', '57f6440d-18a8-43f1-bc66-c4e86b1d807c', 'd1f7ae18-6a8a-43a2-9670-cf857db2bcd9'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6e1316-19c6-4f46-acc5-ec33b7efc404]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:11 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0
Nov 05 04:03:11 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:11 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb2e7df-94fa-4fdf-b71a-844905394ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51b901d2caa4512b21785066bf42f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:09Z,use_quota=True,user_id='965cb2e65cbb4e87ac28f3d69ca0aaf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Creating volume dbb2e7df-94fa-4fdf-b71a-844905394ccc {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:11 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:11 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc 1073741824
Nov 05 04:03:11 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:12 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Deleted volume successfully.
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1dd6ccff-ef86-4c75-92e3-32946cbd89de tempest-CreateVolumesFromImageTest-2008615673 None] Lock "cinder-0bd45e68-994e-40e0-b8c9-811ed6de9374-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:12 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0
Nov 05 04:03:12 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc 1073741824" returned: 0 in 0.589s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-27d95824-45d6-4888-a00d-d1dacfcb21f0" returned: 0 in 0.407s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Lock "cinder-quobyte-27d95824-45d6-4888-a00d-d1dacfcb21f0" released by "delete_volume" :: held 0.962s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:12 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Created reservations ['d65ea01a-e340-41ae-8b5b-4a8d51e56cab', '4babcacc-d91a-4f74-8772-a9b105008679', '46a9a1e4-1c21-4bfe-815f-6edcc07b30f4', '6dcc54e5-ee73-4f48-affe-49956fe1ef4d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:12 devstack sudo[108344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:12 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:12 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc" returned: 0 in 0.366s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:12 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Attempting download of 4db3a0d6-a14e-4320-85ff-62d42bef16c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'metadata': {}}])) to volume dbb2e7df-94fa-4fdf-b71a-844905394ccc. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fc9c5e-44bf-4ae7-b2be-6821a1484c32]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:13 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:13 devstack sudo[108347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6
Nov 05 04:03:13 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Deleted volume successfully.
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-1ce03b56-6497-417a-94d1-09089d570c6e tempest-CinderUnicodeTest-261639694 None] Lock "cinder-27d95824-45d6-4888-a00d-d1dacfcb21f0-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:13 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:13 devstack sudo[108352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6
Nov 05 04:03:13 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:13 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6" returned: 1 in 0.457s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4db3a0d6-a14e-4320-85ff-62d42bef16c7_01qh5qj6' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda4667e-6cfe-4e75-991b-b95d008825f2]: (4, 'raw') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:14 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD
Nov 05 04:03:14 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:14 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:14 devstack sudo[108360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD
Nov 05 04:03:14 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:14 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD' failed. Not Retrying. {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:03:14 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] 4db3a0d6-a14e-4320-85ff-62d42bef16c7 was raw, converting to qcow2 {{(pid=87098) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Nov 05 04:03:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:14 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc
Nov 05 04:03:14 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:15 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc" returned: 0 in 0.707s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:15 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4db3a0d6-a14e-4320-85ff-62d42bef16c7_jsj4i3ondevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:03:15 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:03:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:15 devstack sudo[108371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc 1G
Nov 05 04:03:15 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:16 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc 1G" returned: 0 in 0.586s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Downloaded image 4db3a0d6-a14e-4320-85ff-62d42bef16c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'metadata': {}}])) to volume dbb2e7df-94fa-4fdf-b71a-844905394ccc successfully. {{(pid=87098) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Temporary image 4db3a0d6-a14e-4320-85ff-62d42bef16c7 for user 965cb2e65cbb4e87ac28f3d69ca0aaf3 is deleted. {{(pid=87098) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.volume_utils [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Marking volume dbb2e7df-94fa-4fdf-b71a-844905394ccc as bootable. {{(pid=87098) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Copying metadata from image 4db3a0d6-a14e-4320-85ff-62d42bef16c7 to dbb2e7df-94fa-4fdf-b71a-844905394ccc. {{(pid=87098) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Creating volume glance metadata for volume dbb2e7df-94fa-4fdf-b71a-844905394ccc backed by image 4db3a0d6-a14e-4320-85ff-62d42bef16c7 with: {'image_id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f3ce8e7af99df44d528af9fe2e408d41', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87098) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d65f4d-d0b2-48ef-b0c9-5ba56d6be53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc', 'volume_size': 1, 'image_id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3ce8e7af99df44d528af9fe2e408d41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a51b901d2caa4512b21785066bf42f8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfcc6cb3f04db854b0e164ec87385b94bfebc676a7a9b4b80013a2db145cb987282962534f5cae2178d43a5cfd58711f824c590c9abc4e55de6a3cef19349f37', 'id': '4db3a0d6-a14e-4320-85ff-62d42bef16c7', 'created_at': datetime.datetime(2026, 11, 5, 3, 3, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 3, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4db3a0d6-a14e-4320-85ff-62d42bef16c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73b72ae3c3b0>}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703b549c-a8fb-4588-8ee7-cbc9f5f4f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Volume volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc (dbb2e7df-94fa-4fdf-b71a-844905394ccc): created successfully
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703b549c-a8fb-4588-8ee7-cbc9f5f4f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Flow 'volume_create_manager' (93a7345c-339b-43b8-b9ab-9153660ab37a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-441ed93a-3945-4169-825d-5988dca270c6 tempest-VolumeImageDependencyTests-1772018490 None] Created volume successfully.
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Acquiring lock "cinder-dbb2e7df-94fa-4fdf-b71a-844905394ccc-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Lock "cinder-dbb2e7df-94fa-4fdf-b71a-844905394ccc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Acquiring lock "cinder-quobyte-dbb2e7df-94fa-4fdf-b71a-844905394ccc" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Lock "cinder-quobyte-dbb2e7df-94fa-4fdf-b71a-844905394ccc" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ab8f4-388d-4e56-8bf9-f55cc2618b5c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:17 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc
Nov 05 04:03:17 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:17 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc" returned: 0 in 0.612s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:17 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc
Nov 05 04:03:17 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:17 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dbb2e7df-94fa-4fdf-b71a-844905394ccc" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Lock "cinder-quobyte-dbb2e7df-94fa-4fdf-b71a-844905394ccc" released by "delete_volume" :: held 1.016s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=221,cinder:UPDATE=266,cinder:DELETE=24,cinder:INSERT=73 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=222,cinder:UPDATE=274,cinder:INSERT=72,cinder:DELETE=24 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Created reservations ['e3c8b021-66dc-4c7f-b8d6-37d9be6d7bfb', 'baf5919b-bf9c-4445-a77f-5347e656e12e', '294f4f98-4a33-4b69-b8c8-df12b80ecf9a', '42ad052a-e555-4ce9-834a-f47bf2f74fda'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:18 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:18 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:18 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.364s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:18 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Deleted volume successfully.
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8fae7251-feee-4998-b67f-66a2ff05941a tempest-VolumeImageDependencyTests-1772018490 None] Lock "cinder-dbb2e7df-94fa-4fdf-b71a-844905394ccc-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:18 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3c00e9d8-5309-43a8-92c8-ac41a9116042 tempest-ProjectAdminTests-1729505965 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5548400878906, 'free_capacity_gb': 1773.5548400878906, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87098) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (588bb495-a5fb-4c81-b246-4b3d0be0b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb8679f-869b-45c9-9270-3df040dfd35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb8679f-869b-45c9-9270-3df040dfd35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263080018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc649e4a-6ab1-4786-8bde-6153acd9d1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:27Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a9019b-977e-4aec-95da-2e50453fe212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a9019b-977e-4aec-95da-2e50453fe212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee980b-0dbd-40f1-8d11-58fd09767972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee980b-0dbd-40f1-8d11-58fd09767972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc649e4a-6ab1-4786-8bde-6153acd9d1ff', 'volume_name': 'volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4d69fb-da38-4f25-b097-aebed99db871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4d69fb-da38-4f25-b097-aebed99db871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7404dc4d-65b5-409e-96df-77365c6477d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:26 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Volume cc649e4a-6ab1-4786-8bde-6153acd9d1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff', 'volume_size': 1}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263080018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc649e4a-6ab1-4786-8bde-6153acd9d1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:27Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Creating volume cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:26 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:26 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff 1073741824
Nov 05 04:03:26 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:27 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff 1073741824" returned: 0 in 0.630s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:27 devstack sudo[108396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff
Nov 05 04:03:27 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:27 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (2ccdefc9-dff5-46ab-b090-38aa7c8b26ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c1b146-e076-47a5-b662-f952691858d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" returned: 0 in 0.367s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c1b146-e076-47a5-b662-f952691858d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570067055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67305b3e-cd6f-4947-8c29-bcd36e5048c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:28Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a742a-fc20-4172-9822-c072e9e16354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a742a-fc20-4172-9822-c072e9e16354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a730cf5-d86d-4224-a362-a8e264a9feba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a730cf5-d86d-4224-a362-a8e264a9feba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67305b3e-cd6f-4947-8c29-bcd36e5048c2', 'volume_name': 'volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a61bfd-5e39-4706-9fcf-c6661e36f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a61bfd-5e39-4706-9fcf-c6661e36f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45619c36-bcb4-4fd7-8c9e-57d4f772bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:27 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Volume 67305b3e-cd6f-4947-8c29-bcd36e5048c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2', 'volume_size': 1}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570067055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67305b3e-cd6f-4947-8c29-bcd36e5048c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:28Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Creating volume 67305b3e-cd6f-4947-8c29-bcd36e5048c2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:27 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7404dc4d-65b5-409e-96df-77365c6477d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:27 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb566056-0979-4ead-b755-a8a6da691c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:28 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 1073741824
Nov 05 04:03:28 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Volume volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff (cc649e4a-6ab1-4786-8bde-6153acd9d1ff): created successfully
Nov 05 04:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb566056-0979-4ead-b755-a8a6da691c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:28 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (588bb495-a5fb-4c81-b246-4b3d0be0b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-984bb464-636c-4525-9036-7ae189f8068b tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:03:28 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 1073741824" returned: 0 in 0.618s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:28 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2
Nov 05 04:03:28 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:28 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2" returned: 0 in 0.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45619c36-bcb4-4fd7-8c9e-57d4f772bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105e24b2-dc78-48ad-8712-26f0743c9fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Volume volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 (67305b3e-cd6f-4947-8c29-bcd36e5048c2): created successfully
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105e24b2-dc78-48ad-8712-26f0743c9fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (2ccdefc9-dff5-46ab-b090-38aa7c8b26ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9b19527f-3ed1-462d-969c-da4b698278f3 tempest-ProjectReaderTests-757320180 None] Created volume successfully.
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Creating offline snapshot 98789080-20e9-4b28-812c-f2fee39dae7c of volume cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37b250-0182-432d-93f6-09ff79db7daa]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:29 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff
Nov 05 04:03:29 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:30 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" returned: 0 in 0.594s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:30 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c 1G
Nov 05 04:03:30 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-67305b3e-cd6f-4947-8c29-bcd36e5048c2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Lock "cinder-67305b3e-cd6f-4947-8c29-bcd36e5048c2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-quobyte-67305b3e-cd6f-4947-8c29-bcd36e5048c2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-67305b3e-cd6f-4947-8c29-bcd36e5048c2" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[0700e336-1c7a-4b94-adb0-2ba1ba2743cf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:30 devstack sudo[108416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2
Nov 05 04:03:30 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:30 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c 1G" returned: 0 in 0.706s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:30 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c
Nov 05 04:03:30 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:30 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2" returned: 0 in 0.511s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2
Nov 05 04:03:31 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c" returned: 0 in 0.370s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:31 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c is being set with open permissions: ugo+rw
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c
Nov 05 04:03:31 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-67305b3e-cd6f-4947-8c29-bcd36e5048c2" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-67305b3e-cd6f-4947-8c29-bcd36e5048c2" released by "delete_volume" :: held 0.923s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Created reservations ['4e8e3815-d577-4782-ab2f-e537a44cf451', 'a2b81724-8468-4c66-abfd-c0b6c481079f', '56433655-add0-4856-a2c1-7f588f255660', 'b82d6551-a8c3-4df2-905a-3e403b0e583b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:31 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:31 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c" returned: 0 in 0.414s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:31 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info
Nov 05 04:03:31 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:32 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.572s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Deleted volume successfully.
Nov 05 04:03:32 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info" returned: 0 in 0.514s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info is being set with open permissions: ugo+rw
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8b349a9a-e2fe-46f7-bfee-ed1c18a6af41 tempest-ProjectReaderTests-757320180 None] Lock "cinder-67305b3e-cd6f-4947-8c29-bcd36e5048c2-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:32 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info
Nov 05 04:03:32 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:32 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.info" returned: 0 in 0.317s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-37726ca8-1060-445b-ac40-c1702a7a442d tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-98789080-20e9-4b28-812c-f2fee39dae7c-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-98789080-20e9-4b28-812c-f2fee39dae7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-98789080-20e9-4b28-812c-f2fee39dae7c" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-98789080-20e9-4b28-812c-f2fee39dae7c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot 98789080-20e9-4b28-812c-f2fee39dae7c of volume cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[903d074b-dba1-4a1e-a929-c2a9a80d3745]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:33 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c
Nov 05 04:03:33 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:33 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (4453bb0a-e7b8-40c3-b26d-ec017c700c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef6640a-e18d-491e-967b-57629351164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c" returned: 0 in 0.532s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0238c9e-ef15-40b5-8639-d19f9a9f0f73]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef6640a-e18d-491e-967b-57629351164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957172362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3e9bdb-1884-4c94-ad19-928e81759be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:33Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818e6d0d-7e2c-4c90-8a81-686a252088af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818e6d0d-7e2c-4c90-8a81-686a252088af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab94cd0-dbcd-4dd5-a0cb-83d37bded339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab94cd0-dbcd-4dd5-a0cb-83d37bded339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3e9bdb-1884-4c94-ad19-928e81759be8', 'volume_name': 'volume-af3e9bdb-1884-4c94-ad19-928e81759be8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbe91d5-a70f-4975-9ce9-5543b2227876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbe91d5-a70f-4975-9ce9-5543b2227876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7493d372-5640-4fea-a074-33ba333f05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:33 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Volume af3e9bdb-1884-4c94-ad19-928e81759be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3e9bdb-1884-4c94-ad19-928e81759be8', 'volume_size': 1}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957172362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3e9bdb-1884-4c94-ad19-928e81759be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:33Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Creating volume af3e9bdb-1884-4c94-ad19-928e81759be8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:33 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:33 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8 1073741824
Nov 05 04:03:33 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:33 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff
Nov 05 04:03:33 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (0b5a3b40-9697-41a3-99b5-e2149b59485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:33 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a3a3bd-4f0e-4480-aa93-a426a5ca8c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a3a3bd-4f0e-4480-aa93-a426a5ca8c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243043229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecb5f31-0684-48ff-b5a4-f0fab61cda4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:34Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703700cd-1b00-4a3b-a456-ba30299b1a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703700cd-1b00-4a3b-a456-ba30299b1a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c21ec45-7bee-441b-8620-1027819bcbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c21ec45-7bee-441b-8620-1027819bcbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecb5f31-0684-48ff-b5a4-f0fab61cda4b', 'volume_name': 'volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c334fae1-f260-4c0b-a928-ba62a643f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c334fae1-f260-4c0b-a928-ba62a643f926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a07b93d-5020-43c2-bc60-5c7a57d65e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Volume 0ecb5f31-0684-48ff-b5a4-f0fab61cda4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b', 'volume_size': 1}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:34 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" returned: 0 in 0.622s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c
Nov 05 04:03:34 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8 1073741824" returned: 0 in 0.668s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[108465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8
Nov 05 04:03:34 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243043229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecb5f31-0684-48ff-b5a4-f0fab61cda4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:34Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Creating volume 0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:34 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c
Nov 05 04:03:34 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:34 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:34 devstack sudo[108474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b 1073741824
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7493d372-5640-4fea-a074-33ba333f05cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3e9bdb-1884-4c94-ad19-928e81759be8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:34 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a3afef-3c3d-4e9e-b26f-0646c567400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:34 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Volume volume-af3e9bdb-1884-4c94-ad19-928e81759be8 (af3e9bdb-1884-4c94-ad19-928e81759be8): created successfully
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a3afef-3c3d-4e9e-b26f-0646c567400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (4453bb0a-e7b8-40c3-b26d-ec017c700c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0c13045b-1809-4484-8f80-312bed538a10 tempest-ProjectReaderTests-757320180 None] Created volume successfully.
Nov 05 04:03:34 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff.98789080-20e9-4b28-812c-f2fee39dae7c" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:34 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-98789080-20e9-4b28-812c-f2fee39dae7c" released by "_delete_snapshot" :: held 2.105s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" released by "delete_snapshot" :: held 2.159s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Created reservations ['265722da-191b-4be9-a1c9-90385183f824', '75416172-f7a6-4c0f-925a-7e60715c5459', '1ed90dab-ff13-4f5b-8334-13454f10bb81', '8b66af10-4a11-4289-9ce3-074e32753e34'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-bec19089-0bb0-4ea0-8ef9-dc3ff4a5deb2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-98789080-20e9-4b28-812c-f2fee39dae7c-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:35 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b 1073741824" returned: 0 in 0.559s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:35 devstack sudo[108481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b
Nov 05 04:03:35 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-af3e9bdb-1884-4c94-ad19-928e81759be8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Lock "cinder-af3e9bdb-1884-4c94-ad19-928e81759be8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:35 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-quobyte-af3e9bdb-1884-4c94-ad19-928e81759be8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a07b93d-5020-43c2-bc60-5c7a57d65e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67206e0-b6e5-4651-976e-a91678f98483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-af3e9bdb-1884-4c94-ad19-928e81759be8" acquired by "delete_volume" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:35 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Volume volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b (0ecb5f31-0684-48ff-b5a4-f0fab61cda4b): created successfully
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67206e0-b6e5-4651-976e-a91678f98483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (0b5a3b40-9697-41a3-99b5-e2149b59485a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9612ac47-196f-4989-9db1-7100f0574882]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:35 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0bce46dd-2c0a-436f-b2b1-c818727842fa tempest-ProjectReaderTests-1380422473 None] Created volume successfully.
Nov 05 04:03:35 devstack sudo[108484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8
Nov 05 04:03:35 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-cc649e4a-6ab1-4786-8bde-6153acd9d1ff-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Lock "cinder-cc649e4a-6ab1-4786-8bde-6153acd9d1ff-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb83174-8590-4342-ad26-c1a514097de3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:36 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8" returned: 0 in 0.634s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:36 devstack sudo[108491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8
Nov 05 04:03:36 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff
Nov 05 04:03:36 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Creating offline snapshot 631b1efc-8c75-4dc4-b915-0f49ebe834dd of volume 0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0ddcf-9c8f-4609-a808-4501d369aaf0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:36 devstack sudo[108494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b
Nov 05 04:03:36 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-af3e9bdb-1884-4c94-ad19-928e81759be8" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-af3e9bdb-1884-4c94-ad19-928e81759be8" released by "delete_volume" :: held 1.195s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:36 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" returned: 0 in 0.616s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:36 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff
Nov 05 04:03:36 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Created reservations ['ee9eed2d-4e4f-49d7-b46d-88cc3fb7038e', 'db9250e7-58b5-4dcc-bef6-12819c3f48d3', '8e0c47e8-b902-4027-9d31-0b157bffdb74', '5105df8f-323a-4991-9773-0501c74ec0c2'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:37 devstack sudo[108503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:37 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:37 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" returned: 0 in 0.591s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:37 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd 1G
Nov 05 04:03:37 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:37 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-cc649e4a-6ab1-4786-8bde-6153acd9d1ff" released by "delete_volume" :: held 1.122s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:37 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.355s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Deleted volume successfully.
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Created reservations ['b764a804-c4b9-40b3-a6b7-884013ceabfe', 'c875c4a6-7daf-42e0-a5b0-48b861133cd0', '38e8f6ac-87ea-441e-b71d-9bf4422888f6', '5caf9e22-f393-4125-8bca-ce0b430e3910'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-988a2382-4e51-4b89-bdb5-e9a01e8b059a tempest-ProjectReaderTests-757320180 None] Lock "cinder-af3e9bdb-1884-4c94-ad19-928e81759be8-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:37 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:37 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:37 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd 1G" returned: 0 in 0.566s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:37 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd
Nov 05 04:03:37 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:37 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:37 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:03:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7aa85ce5-ea24-4c5a-9fcc-c1daa7738cbb tempest-ProjectMemberTests-873972974 None] Lock "cinder-cc649e4a-6ab1-4786-8bde-6153acd9d1ff-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:38 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd" returned: 0 in 0.416s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:38 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd is being set with open permissions: ugo+rw
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:38 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd
Nov 05 04:03:38 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (c3b98bb1-b7ad-4bc7-bea7-f71dfec6b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44626481-069b-43d7-ab03-197b7059ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:38 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44626481-069b-43d7-ab03-197b7059ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116302462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fecb141-677d-4a90-ba9b-cdfeb40f2988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:39Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92266a43-f294-4d4f-8c0e-874d1696f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92266a43-f294-4d4f-8c0e-874d1696f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7ae08b-283d-4d13-b69d-33f2d9b03c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7ae08b-283d-4d13-b69d-33f2d9b03c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fecb141-677d-4a90-ba9b-cdfeb40f2988', 'volume_name': 'volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ae5212-e2d7-408f-a365-f3d4e7154932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ae5212-e2d7-408f-a365-f3d4e7154932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec8e392-3019-49a5-b547-a8e8baca6f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:38 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Volume 8fecb141-677d-4a90-ba9b-cdfeb40f2988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988', 'volume_size': 1}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:38 devstack sudo[108528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info
Nov 05 04:03:38 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:39 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:39 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info is being set with open permissions: ugo+rw
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:39 devstack sudo[108531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info
Nov 05 04:03:39 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (3daa6bd1-7f05-45ac-960c-dca26575fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50c5bd4-3243-4c4c-b557-72b1459093cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50c5bd4-3243-4c4c-b557-72b1459093cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113005159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc32361c-6276-4240-81f4-820f77ddb194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:39Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c07f88-cb90-483c-9736-3c158a91c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c07f88-cb90-483c-9736-3c158a91c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f64901-d936-4fcf-90d1-f3d257c65bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f64901-d936-4fcf-90d1-f3d257c65bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc32361c-6276-4240-81f4-820f77ddb194', 'volume_name': 'volume-fc32361c-6276-4240-81f4-820f77ddb194', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c7eb19-9c3d-41b4-bb55-ebfbbbb853f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c7eb19-9c3d-41b4-bb55-ebfbbbb853f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ba7006-cbbc-4912-a662-57c8866a6e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Volume fc32361c-6276-4240-81f4-820f77ddb194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc32361c-6276-4240-81f4-820f77ddb194', 'volume_size': 1}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:39 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.info" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.992s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1116302462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fecb141-677d-4a90-ba9b-cdfeb40f2988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:39Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Creating volume 8fecb141-677d-4a90-ba9b-cdfeb40f2988 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:39 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 1073741824
Nov 05 04:03:39 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-13155fe1-00ab-4c9c-a94c-214fd52f2084 tempest-ProjectReaderTests-1380422473 None] Create snapshot completed successfully
Nov 05 04:03:40 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 1073741824" returned: 0 in 0.558s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:40 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988
Nov 05 04:03:40 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:40 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113005159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc32361c-6276-4240-81f4-820f77ddb194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:39Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Creating volume fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:40 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec8e392-3019-49a5-b547-a8e8baca6f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:40 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 1073741824
Nov 05 04:03:40 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08537b17-cfe9-4b40-9491-37970dbeb629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:40 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Volume volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 (8fecb141-677d-4a90-ba9b-cdfeb40f2988): created successfully
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08537b17-cfe9-4b40-9491-37970dbeb629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (c3b98bb1-b7ad-4bc7-bea7-f71dfec6b977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:40 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-e97b9d02-7b46-41a4-af8c-61e8d6ff492d tempest-ProjectReaderTests-757320180 None] Created volume successfully.
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-8fecb141-677d-4a90-ba9b-cdfeb40f2988-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Lock "cinder-8fecb141-677d-4a90-ba9b-cdfeb40f2988-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-quobyte-8fecb141-677d-4a90-ba9b-cdfeb40f2988" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-8fecb141-677d-4a90-ba9b-cdfeb40f2988" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fead96-eca2-4d10-aef8-4f975c80b2a9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:40 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 1073741824" returned: 0 in 0.614s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988
Nov 05 04:03:41 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194
Nov 05 04:03:41 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-631b1efc-8c75-4dc4-b915-0f49ebe834dd-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-631b1efc-8c75-4dc4-b915-0f49ebe834dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-631b1efc-8c75-4dc4-b915-0f49ebe834dd" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-631b1efc-8c75-4dc4-b915-0f49ebe834dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Deleting offline snapshot 631b1efc-8c75-4dc4-b915-0f49ebe834dd of volume 0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] snapshot_file for this snap is: volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b030ac-5c58-44f4-a278-604a8e47b80c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ba7006-cbbc-4912-a662-57c8866a6e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc32361c-6276-4240-81f4-820f77ddb194', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcb0208-6ceb-4e54-8e7f-c7d423187145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:41 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988" returned: 0 in 0.555s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Volume volume-fc32361c-6276-4240-81f4-820f77ddb194 (fc32361c-6276-4240-81f4-820f77ddb194): created successfully
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcb0208-6ceb-4e54-8e7f-c7d423187145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (3daa6bd1-7f05-45ac-960c-dca26575fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:41 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988
Nov 05 04:03:41 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c6312754-b48a-4578-8166-3698257411b1 tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:03:41 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd
Nov 05 04:03:41 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:41 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8fecb141-677d-4a90-ba9b-cdfeb40f2988" returned: 0 in 0.329s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-8fecb141-677d-4a90-ba9b-cdfeb40f2988" released by "delete_volume" :: held 0.938s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:41 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd" returned: 0 in 0.459s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf84ba-ec2b-4a0c-911e-256c50dfa365]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:41 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Created reservations ['7ded6fc0-dcde-4b00-832b-64d221a45fa4', '0c692e17-173f-4713-a70e-2a784e9aa390', '9519b384-4c4e-4db9-8121-557eded569f0', 'd91f3a71-f439-4ba0-8cce-fee0df8cca37'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:42 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b
Nov 05 04:03:42 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:42 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:42 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:42 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.341s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:42 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Deleted volume successfully.
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b83c5f35-199c-4359-9168-342513fefd96 tempest-ProjectReaderTests-757320180 None] Lock "cinder-8fecb141-677d-4a90-ba9b-cdfeb40f2988-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:42 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" returned: 0 in 0.567s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:42 devstack sudo[108575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd
Nov 05 04:03:42 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Creating offline snapshot d405081e-01f2-4ccb-a841-bbf32763a817 of volume fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dcae16-b69b-41cf-9296-e8c69878e382]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:42 devstack sudo[108577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194
Nov 05 04:03:42 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:42 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd" returned: 0 in 0.414s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:42 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd
Nov 05 04:03:42 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:43 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:43 devstack sudo[108588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 1G
Nov 05 04:03:43 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:43 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b.631b1efc-8c75-4dc4-b915-0f49ebe834dd" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-631b1efc-8c75-4dc4-b915-0f49ebe834dd" released by "_delete_snapshot" :: held 1.930s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" released by "delete_snapshot" :: held 1.964s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Created reservations ['38ecf534-7e1e-4fcc-9e49-59af80ed85ae', 'b78f2612-d6a6-4f66-b0a8-1b335f29e853', 'ad253922-a236-4994-b401-a1d1f7c2ee56', '1055e9ff-6198-4830-8c4d-90eae1e0c8f1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Delete snapshot completed successfully.
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-cb0a600c-5821-4c79-9921-9d556cd05475 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-631b1efc-8c75-4dc4-b915-0f49ebe834dd-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:43 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 1G" returned: 0 in 0.587s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc32361c-6276-4240-81f4-820f77ddb194 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:43 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc32361c-6276-4240-81f4-820f77ddb194 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817
Nov 05 04:03:43 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (028e16c3-13ad-40bd-9871-66a3752ce266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b85ef55-dee5-4cdd-8ae6-d460d8d936b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b85ef55-dee5-4cdd-8ae6-d460d8d936b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851732312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832028a2-76f5-4ac5-a245-8bb8f5dabcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:44Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a288e57c-e2af-4843-8364-cf968566de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a288e57c-e2af-4843-8364-cf968566de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d01b7e8-f9fc-4d48-bc6e-5f3e91b30a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d01b7e8-f9fc-4d48-bc6e-5f3e91b30a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832028a2-76f5-4ac5-a245-8bb8f5dabcc1', 'volume_name': 'volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d557d8c-7f4b-47e1-8ab6-7cf0a124395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d557d8c-7f4b-47e1-8ab6-7cf0a124395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cf54da-054f-4a6e-b914-39ea07c3fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:43 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Volume 832028a2-76f5-4ac5-a245-8bb8f5dabcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1', 'volume_size': 1}
Nov 05 04:03:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:44 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc32361c-6276-4240-81f4-820f77ddb194 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817" returned: 0 in 0.332s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:44 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 is being set with open permissions: ugo+rw
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:44 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817
Nov 05 04:03:44 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:44 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817" returned: 0 in 0.270s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:44 devstack sudo[108603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info
Nov 05 04:03:44 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" acquired by "delete_volume" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:44 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:44 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info is being set with open permissions: ugo+rw
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee74f8d-9ee0-4b7b-9ff4-c2cdb526961f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:44 devstack sudo[108606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info
Nov 05 04:03:44 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:44 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b
Nov 05 04:03:44 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:45 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.info" returned: 0 in 0.327s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851732312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832028a2-76f5-4ac5-a245-8bb8f5dabcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63468b294cad4cfea96124a9922a4ecb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:44Z,use_quota=True,user_id='8ff21d9db1db451b861a6f56dd713f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Creating volume 832028a2-76f5-4ac5-a245-8bb8f5dabcc1 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:45 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:45 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 1073741824
Nov 05 04:03:45 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:45 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b93cca38-b0e0-410d-b526-36c3cfd041e3 tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:03:45 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" returned: 0 in 0.513s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:45 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b
Nov 05 04:03:45 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:45 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" returned: 0 in 0.314s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b" released by "delete_volume" :: held 0.920s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Created reservations ['5cc6c3b6-81a7-4cfb-a252-cb3f8a0dd3ce', '8a8c0fe1-7491-45d0-9132-9b9fdf75b40c', 'f7b3bbbb-c626-41da-a6e0-024046329ef8', '3f17b315-bf35-4ee1-8808-4b7625110502'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:45 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 1073741824" returned: 0 in 0.600s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:45 devstack sudo[108623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1
Nov 05 04:03:45 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-d405081e-01f2-4ccb-a841-bbf32763a817-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:45 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Lock "cinder-d405081e-01f2-4ccb-a841-bbf32763a817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-fc32361c-6276-4240-81f4-820f77ddb194" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:45 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fc32361c-6276-4240-81f4-820f77ddb194" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-d405081e-01f2-4ccb-a841-bbf32763a817" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-d405081e-01f2-4ccb-a841-bbf32763a817" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot d405081e-01f2-4ccb-a841-bbf32763a817 of volume fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:45 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c57c6-3ebd-4810-b266-ecca7d810642]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:46 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1" returned: 0 in 0.312s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:46 devstack sudo[108627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cf54da-054f-4a6e-b914-39ea07c3fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:46 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b4cb2a-6d24-44f0-b976-57833eecc782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:46 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Volume volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 (832028a2-76f5-4ac5-a245-8bb8f5dabcc1): created successfully
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b4cb2a-6d24-44f0-b976-57833eecc782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Flow 'volume_create_manager' (028e16c3-13ad-40bd-9871-66a3752ce266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:46 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.337s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8b479c33-c10d-4d1e-b086-9bbdf82a6041 tempest-ProjectReaderTests-757320180 None] Created volume successfully.
Nov 05 04:03:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Deleted volume successfully.
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8841fb8e-624c-4d1f-9d31-42e27e1678b7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-0ecb5f31-0684-48ff-b5a4-f0fab61cda4b-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:46 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc32361c-6276-4240-81f4-820f77ddb194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe49eea-2d92-4c96-bcad-a0fe29b5b573]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:46 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194
Nov 05 04:03:46 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-832028a2-76f5-4ac5-a245-8bb8f5dabcc1-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Lock "cinder-832028a2-76f5-4ac5-a245-8bb8f5dabcc1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Acquiring lock "cinder-quobyte-832028a2-76f5-4ac5-a245-8bb8f5dabcc1" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-832028a2-76f5-4ac5-a245-8bb8f5dabcc1" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:47 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194" returned: 0 in 0.662s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf64755f-d68f-4067-9b65-71eacf8c9ded]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:47 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817
Nov 05 04:03:47 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:47 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1
Nov 05 04:03:47 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (a09c9d37-c4de-4458-854b-a4832c7e8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97b5c33-6da3-4ceb-b3a6-f841d8fc3aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97b5c33-6da3-4ceb-b3a6-f841d8fc3aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-396190052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6743debc-9f1d-4015-b2e1-a69254d476c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:48Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e40fac-17b7-4e62-a06b-4a2637a822cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e40fac-17b7-4e62-a06b-4a2637a822cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9688aac5-8763-4f75-88ed-1a02446fb610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9688aac5-8763-4f75-88ed-1a02446fb610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6743debc-9f1d-4015-b2e1-a69254d476c7', 'volume_name': 'volume-6743debc-9f1d-4015-b2e1-a69254d476c7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:47 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4301fdd8-ef4f-4046-bf2e-c00fed96738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4301fdd8-ef4f-4046-bf2e-c00fed96738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfe42db-1c1f-4ded-9d9c-7e26713c8e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:47 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Volume 6743debc-9f1d-4015-b2e1-a69254d476c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6743debc-9f1d-4015-b2e1-a69254d476c7', 'volume_size': 1}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-396190052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6743debc-9f1d-4015-b2e1-a69254d476c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:48Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Creating volume 6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:47 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:47 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:47 devstack sudo[108652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 1073741824
Nov 05 04:03:47 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:47 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817
Nov 05 04:03:47 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:47 devstack sudo[108655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1
Nov 05 04:03:47 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:48 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194.d405081e-01f2-4ccb-a841-bbf32763a817" returned: 0 in 0.330s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:48 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-832028a2-76f5-4ac5-a245-8bb8f5dabcc1" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-d405081e-01f2-4ccb-a841-bbf32763a817" released by "_delete_snapshot" :: held 2.201s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fc32361c-6276-4240-81f4-820f77ddb194" released by "delete_snapshot" :: held 2.232s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Lock "cinder-quobyte-832028a2-76f5-4ac5-a245-8bb8f5dabcc1" released by "delete_volume" :: held 1.028s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Created reservations ['24d97387-81fc-4464-9e00-3a584371b962', 'c2f0f5fb-0adc-4081-81c4-9950a4099328', '1f1b649e-8254-4f57-b750-b548d0961ba3', '0eefbaa2-9150-4e23-803c-15ee87830cf0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Created reservations ['061b4690-c588-4dfe-9ab4-ae6c7f68e493', 'b5862855-5a1b-402f-9cd3-fca1bfcdcc00', 'c25c6b76-942b-46fd-a2c7-a877efc995a9', 'c50eae32-f929-4970-9ad3-a52d28453890'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:48 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 1073741824" returned: 0 in 0.683s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:48 devstack sudo[108664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:48 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fa2d945f-d297-4617-a49c-82ba094a008b tempest-ProjectMemberTests-873972974 None] Lock "cinder-d405081e-01f2-4ccb-a841-bbf32763a817-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:48 devstack sudo[108666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7
Nov 05 04:03:48 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:48 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Deleted volume successfully.
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-68aa323e-c5dd-4730-bb76-f639509c592d tempest-ProjectReaderTests-757320180 None] Lock "cinder-832028a2-76f5-4ac5-a245-8bb8f5dabcc1-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:48 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7" returned: 0 in 0.348s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfe42db-1c1f-4ded-9d9c-7e26713c8e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6743debc-9f1d-4015-b2e1-a69254d476c7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca1d4b-3115-498a-8f02-546da4068561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Volume volume-6743debc-9f1d-4015-b2e1-a69254d476c7 (6743debc-9f1d-4015-b2e1-a69254d476c7): created successfully
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca1d4b-3115-498a-8f02-546da4068561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (a09c9d37-c4de-4458-854b-a4832c7e8375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:48 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-76fcff86-5cea-49c0-ba36-4d48d81f5652 tempest-ProjectReaderTests-1380422473 None] Created volume successfully.
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-fc32361c-6276-4240-81f4-820f77ddb194-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Lock "cinder-fc32361c-6276-4240-81f4-820f77ddb194-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-fc32361c-6276-4240-81f4-820f77ddb194" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fc32361c-6276-4240-81f4-820f77ddb194" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[89341e8e-c452-4451-8931-a01cc3fe1aa8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:49 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194
Nov 05 04:03:49 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:49 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194" returned: 0 in 0.637s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:50 devstack sudo[108675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194
Nov 05 04:03:50 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Creating offline snapshot c9d6dff5-2411-43b1-89ab-1ed335de9612 of volume 6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddaf2f4-0637-47cd-9d61-8630788071bb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:50 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7
Nov 05 04:03:50 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:50 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fc32361c-6276-4240-81f4-820f77ddb194" returned: 0 in 0.411s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fc32361c-6276-4240-81f4-820f77ddb194" released by "delete_volume" :: held 1.156s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Created reservations ['8f936020-f848-4148-b517-f92e224a51e1', 'a2eef219-923e-4450-8187-345c9601a84f', '2f6fd713-0513-48e3-a105-3e6c144f0509', '9c3567be-06f8-48f1-a715-6ac6c723c827'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:50 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7" returned: 0 in 0.583s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:50 devstack sudo[108683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:50 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:50 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 1G
Nov 05 04:03:50 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:51 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.444s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-44b134ad-b500-458d-8b42-f4a027d99ec1 tempest-ProjectMemberTests-873972974 None] Lock "cinder-fc32361c-6276-4240-81f4-820f77ddb194-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:51 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 1G" returned: 0 in 0.565s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6743debc-9f1d-4015-b2e1-a69254d476c7 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:51 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6743debc-9f1d-4015-b2e1-a69254d476c7 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612
Nov 05 04:03:51 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:51 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6743debc-9f1d-4015-b2e1-a69254d476c7 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612" returned: 0 in 0.385s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 is being set with open permissions: ugo+rw
Nov 05 04:03:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:51 devstack sudo[108698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612
Nov 05 04:03:51 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:52 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:52 devstack sudo[108701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info
Nov 05 04:03:52 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (d60626c1-aeb9-4e29-8b0d-70fe3d3c660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9744903-fb91-40ea-86c0-29c5e64a892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9744903-fb91-40ea-86c0-29c5e64a892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-59050793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552b602d-629c-4632-ab03-a6352b3b515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:52Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98727a37-29fe-490c-bcae-c7bfa9459b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98727a37-29fe-490c-bcae-c7bfa9459b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61aa69f8-000f-43d6-a4c4-d073a7bf3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61aa69f8-000f-43d6-a4c4-d073a7bf3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '552b602d-629c-4632-ab03-a6352b3b515d', 'volume_name': 'volume-552b602d-629c-4632-ab03-a6352b3b515d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9807fe3d-e951-4ff4-a773-4cfbd015deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9807fe3d-e951-4ff4-a773-4cfbd015deb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c363aa19-7947-4fc5-9211-7312e872787e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:52 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Volume 552b602d-629c-4632-ab03-a6352b3b515d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-552b602d-629c-4632-ab03-a6352b3b515d', 'volume_size': 1}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:52 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:52 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info is being set with open permissions: ugo+rw
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:52 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info
Nov 05 04:03:52 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:52 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.info" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-59050793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552b602d-629c-4632-ab03-a6352b3b515d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:52Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Creating volume 552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:52 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:52 devstack sudo[108708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d 1073741824
Nov 05 04:03:52 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:52 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ef2066f1-7448-4ad8-96b4-3295a93290e8 tempest-ProjectReaderTests-1380422473 None] Create snapshot completed successfully
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-c9d6dff5-2411-43b1-89ab-1ed335de9612-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-c9d6dff5-2411-43b1-89ab-1ed335de9612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-6743debc-9f1d-4015-b2e1-a69254d476c7" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:53 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-6743debc-9f1d-4015-b2e1-a69254d476c7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-c9d6dff5-2411-43b1-89ab-1ed335de9612" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d 1073741824" returned: 0 in 0.589s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-c9d6dff5-2411-43b1-89ab-1ed335de9612" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Deleting offline snapshot c9d6dff5-2411-43b1-89ab-1ed335de9612 of volume 6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] snapshot_file for this snap is: volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c55b0-ec8a-4483-a43e-93de1f2f5b71]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:53 devstack sudo[108715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d
Nov 05 04:03:53 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:53 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612
Nov 05 04:03:53 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:53 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d" returned: 0 in 0.328s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c363aa19-7947-4fc5-9211-7312e872787e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552b602d-629c-4632-ab03-a6352b3b515d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560703e-cb62-4a6b-a553-daf14c07991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:53 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Volume volume-552b602d-629c-4632-ab03-a6352b3b515d (552b602d-629c-4632-ab03-a6352b3b515d): created successfully
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560703e-cb62-4a6b-a553-daf14c07991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (d60626c1-aeb9-4e29-8b0d-70fe3d3c660e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9da818c4-2f8d-4a5e-b430-f1313aa743b4 tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:03:53 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612" returned: 0 in 0.448s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6743debc-9f1d-4015-b2e1-a69254d476c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[826b7e19-49ff-4567-a27a-a9732ceeb802]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:53 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7
Nov 05 04:03:53 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:54 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7" returned: 0 in 0.560s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:54 devstack sudo[108727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612
Nov 05 04:03:54 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Creating offline snapshot e1c60e55-b8d4-46c3-94dd-5be3b4d08915 of volume 552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b06595-62b2-44de-b4d4-84a875b21ae1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:54 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d
Nov 05 04:03:54 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:54 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:54 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612
Nov 05 04:03:54 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:54 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d" returned: 0 in 0.400s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:55 devstack sudo[108739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 1G
Nov 05 04:03:55 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:55 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7.c9d6dff5-2411-43b1-89ab-1ed335de9612" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-c9d6dff5-2411-43b1-89ab-1ed335de9612" released by "_delete_snapshot" :: held 1.929s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-6743debc-9f1d-4015-b2e1-a69254d476c7" released by "delete_snapshot" :: held 1.964s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Created reservations ['af38c985-c44f-4c8d-97cd-047411afda9d', '471966a7-afb8-470d-89d4-11816c767651', 'bed2e02b-8677-4700-9f49-b8da0794b49d', '5497e341-3b1d-4ebe-9bc4-e7ffca99ba87'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:55 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Delete snapshot completed successfully.
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Flow 'volume_create_manager' (97b0e70f-51ba-4e18-85e3-7fa0e0109d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44d5ce0-a604-4d79-a92a-f79cef5f7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f5914831-2b4c-40c9-8ea5-7a4817021166 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-c9d6dff5-2411-43b1-89ab-1ed335de9612-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44d5ce0-a604-4d79-a92a-f79cef5f7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1210732591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a8dac7-44a3-409c-8220-42e16c42b48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468a27ebfe6e43ec94c58709deadf43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:55Z,use_quota=True,user_id='5552709376d04fd0af72cdb42bc82190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:55 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f408f3e-e41f-4523-9806-4444ba01ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f408f3e-e41f-4523-9806-4444ba01ac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec82080-c9e8-46ab-8edd-4a6d0f1424c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec82080-c9e8-46ab-8edd-4a6d0f1424c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a8dac7-44a3-409c-8220-42e16c42b48f', 'volume_name': 'volume-88a8dac7-44a3-409c-8220-42e16c42b48f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5097e9bc-a0d3-4085-8ad4-fe1d979d509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5097e9bc-a0d3-4085-8ad4-fe1d979d509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45955902-2f36-4401-bb37-16b4aed33381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Volume 88a8dac7-44a3-409c-8220-42e16c42b48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a8dac7-44a3-409c-8220-42e16c42b48f', 'volume_size': 1}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 1G" returned: 0 in 0.570s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-552b602d-629c-4632-ab03-a6352b3b515d -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:55 devstack sudo[108746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-552b602d-629c-4632-ab03-a6352b3b515d -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915
Nov 05 04:03:55 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:55 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-552b602d-629c-4632-ab03-a6352b3b515d -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915" returned: 0 in 0.310s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:55 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 is being set with open permissions: ugo+rw
Nov 05 04:03:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:55 devstack sudo[108751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915
Nov 05 04:03:55 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:56 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915" returned: 0 in 0.267s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:56 devstack sudo[108754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info
Nov 05 04:03:56 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:56 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info" returned: 0 in 0.258s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:56 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info is being set with open permissions: ugo+rw
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:56 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info
Nov 05 04:03:56 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-6743debc-9f1d-4015-b2e1-a69254d476c7-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-6743debc-9f1d-4015-b2e1-a69254d476c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-6743debc-9f1d-4015-b2e1-a69254d476c7" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-6743debc-9f1d-4015-b2e1-a69254d476c7" acquired by "delete_volume" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d4778e-92bd-40a5-8f34-e061c97ab18c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:56 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.info" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1210732591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a8dac7-44a3-409c-8220-42e16c42b48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468a27ebfe6e43ec94c58709deadf43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:55Z,use_quota=True,user_id='5552709376d04fd0af72cdb42bc82190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Creating volume 88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:56 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:56 devstack sudo[108760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7
Nov 05 04:03:56 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:56 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f 1073741824
Nov 05 04:03:56 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-67a3524d-fc55-4ca5-aed3-88a9e403463e tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:03:57 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:57 devstack sudo[108770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7
Nov 05 04:03:57 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:57 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f 1073741824" returned: 0 in 0.483s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:57 devstack sudo[108774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f
Nov 05 04:03:57 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:57 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6743debc-9f1d-4015-b2e1-a69254d476c7" returned: 0 in 0.295s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-6743debc-9f1d-4015-b2e1-a69254d476c7" released by "delete_volume" :: held 0.789s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Created reservations ['6c933b30-86e6-46e0-95db-d574cb79e938', '6479b674-0457-4d88-bc43-caa16faedba2', '291b0760-b538-43a0-83e5-c841c97155b0', '13a33376-c583-4d4a-aefc-8fb177d24eb1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:57 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:03:57 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:57 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45955902-2f36-4401-bb37-16b4aed33381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a8dac7-44a3-409c-8220-42e16c42b48f', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58670949-bd45-4560-8101-f8616847c9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:57 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Volume volume-88a8dac7-44a3-409c-8220-42e16c42b48f (88a8dac7-44a3-409c-8220-42e16c42b48f): created successfully
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58670949-bd45-4560-8101-f8616847c9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Flow 'volume_create_manager' (97b0e70f-51ba-4e18-85e3-7fa0e0109d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0263cb31-309b-4aa5-ba4b-f8233999d0c5 tempest-SnapshotDependencyTests-457595757 None] Created volume successfully.
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-e1c60e55-b8d4-46c3-94dd-5be3b4d08915-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Lock "cinder-e1c60e55-b8d4-46c3-94dd-5be3b4d08915-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-552b602d-629c-4632-ab03-a6352b3b515d" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-552b602d-629c-4632-ab03-a6352b3b515d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-e1c60e55-b8d4-46c3-94dd-5be3b4d08915" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-e1c60e55-b8d4-46c3-94dd-5be3b4d08915" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot e1c60e55-b8d4-46c3-94dd-5be3b4d08915 of volume 552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1270909-98b2-4b8b-b8e5-e72a4df04be6]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:57 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.363s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:03:57 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Deleted volume successfully.
Nov 05 04:03:57 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-341b3867-08f0-4f04-8b81-e4e6e2fd578d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-6743debc-9f1d-4015-b2e1-a69254d476c7-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:58 devstack sudo[108781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915
Nov 05 04:03:58 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (6e5a3430-bda1-4b20-b16d-995e50ddcaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8100b99f-8f40-4271-a2d4-0f62defbd197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:58 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8100b99f-8f40-4271-a2d4-0f62defbd197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703899416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:58Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9bac26-e059-4bf4-ad82-c236fb18b471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9bac26-e059-4bf4-ad82-c236fb18b471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68767c5f-1d5f-438c-9968-4b747627f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68767c5f-1d5f-438c-9968-4b747627f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290', 'volume_name': 'volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865833e7-2fb8-4a6a-aec3-e9f00ccc7001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865833e7-2fb8-4a6a-aec3-e9f00ccc7001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbbfe62-a966-438b-8b62-6255487a6917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:58 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Volume 1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290', 'volume_size': 1}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703899416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:58Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Creating volume 1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:03:58 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915" returned: 0 in 0.495s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-552b602d-629c-4632-ab03-a6352b3b515d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:03:58 devstack sudo[108786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 1073741824
Nov 05 04:03:58 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4fa139-f477-422a-8e66-e81171ce88fd]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:58 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d
Nov 05 04:03:58 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:58 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 1073741824" returned: 0 in 0.561s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:58 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d" returned: 0 in 0.501s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:58 devstack sudo[108797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915
Nov 05 04:03:58 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:59 devstack sudo[108799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290
Nov 05 04:03:59 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:03:59 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" returned: 0 in 0.334s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.062s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbbfe62-a966-438b-8b62-6255487a6917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38387ec0-6563-44fc-b686-0afd7aa22a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Creating offline snapshot c6889545-c0b2-4795-820e-12254b2a1361 of volume 88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:03:59 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Volume volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 (1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290): created successfully
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38387ec0-6563-44fc-b686-0afd7aa22a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (6e5a3430-bda1-4b20-b16d-995e50ddcaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:03:59 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a04a76b-7cd9-40c8-9cf5-22917ef99834]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915" returned: 0 in 0.461s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0c0f7507-9f37-4d6c-a5cc-6d805aef6fb4 tempest-ProjectReaderTests-1380422473 None] Created volume successfully.
Nov 05 04:03:59 devstack sudo[108807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915
Nov 05 04:03:59 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:59 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f
Nov 05 04:03:59 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:59 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d.e1c60e55-b8d4-46c3-94dd-5be3b4d08915" returned: 0 in 0.281s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-e1c60e55-b8d4-46c3-94dd-5be3b4d08915" released by "_delete_snapshot" :: held 1.907s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-552b602d-629c-4632-ab03-a6352b3b515d" released by "delete_snapshot" :: held 1.940s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:03:59 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f" returned: 0 in 0.442s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:03:59 devstack sudo[108814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 1G
Nov 05 04:03:59 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Created reservations ['bb774b60-bdc8-4b43-9953-3612cb4c5199', 'bc6e1d41-3435-48a1-9d8c-d65d73ba19d0', 'e6fc808e-db44-4a67-a934-99a26bf367b5', '7c0fd226-78ad-4107-a4c1-9843611fa1ee'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:03:59 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:03:59 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-93224c72-cd33-4f04-972b-6c4572e77221 tempest-ProjectMemberTests-873972974 None] Lock "cinder-e1c60e55-b8d4-46c3-94dd-5be3b4d08915-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:00 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 1G" returned: 0 in 0.504s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a8dac7-44a3-409c-8220-42e16c42b48f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:00 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a8dac7-44a3-409c-8220-42e16c42b48f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361
Nov 05 04:04:00 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:00 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a8dac7-44a3-409c-8220-42e16c42b48f -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361" returned: 0 in 0.345s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:00 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 is being set with open permissions: ugo+rw
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:00 devstack sudo[108827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361
Nov 05 04:04:00 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-552b602d-629c-4632-ab03-a6352b3b515d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:00 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Lock "cinder-552b602d-629c-4632-ab03-a6352b3b515d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:01 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info
Nov 05 04:04:01 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-552b602d-629c-4632-ab03-a6352b3b515d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-552b602d-629c-4632-ab03-a6352b3b515d" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d72fa26-ae1d-413c-8ae4-026b5e5f11d0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:01 devstack sudo[108832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d
Nov 05 04:04:01 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:01 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info" returned: 0 in 0.320s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:01 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info is being set with open permissions: ugo+rw
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:01 devstack sudo[108835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info
Nov 05 04:04:01 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:01 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d" returned: 0 in 0.468s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:01 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.info" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:01 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d
Nov 05 04:04:01 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.139s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Creating offline snapshot 2e69e66e-16db-4a0b-a38a-8799a18fafd0 of volume 1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:01 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-599350b7-9c4a-4f95-a23c-c12951e5a0ab tempest-SnapshotDependencyTests-457595757 None] Create snapshot completed successfully
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5a3956-5911-451d-bf7c-4057b360ec6c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:01 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290
Nov 05 04:04:01 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:01 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-552b602d-629c-4632-ab03-a6352b3b515d" returned: 0 in 0.301s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-552b602d-629c-4632-ab03-a6352b3b515d" released by "delete_volume" :: held 0.850s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Created reservations ['4d87d8e4-49c2-48b0-b36b-258dbfe6cc69', '0a8c26a0-eac1-4e16-96f7-341b6596e60e', '8843a91d-a630-4a25-b9e3-680166d34a52', '383f62e7-0cf5-4008-b36a-dd810ea5719b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:02 devstack sudo[108884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:02 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:02 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" returned: 0 in 0.474s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:02 devstack sudo[108887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 1G
Nov 05 04:04:02 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:02 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ca1a9b5e-5b47-4917-8dc8-36fd684fad15 tempest-ProjectMemberTests-873972974 None] Lock "cinder-552b602d-629c-4632-ab03-a6352b3b515d-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (c5075473-bebc-48ec-b149-3425651da141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a04789-8e6b-49d7-96cd-1fead3b1051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:02 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 1G" returned: 0 in 0.605s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a04789-8e6b-49d7-96cd-1fead3b1051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486936750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400e4cee-3b82-462c-ab5b-b0cf5eaff8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:03Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeb23b6-706c-48e5-b83e-fde2ce012bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeb23b6-706c-48e5-b83e-fde2ce012bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96823b4c-db95-4eb6-8baf-93dc1371d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:02 devstack sudo[108895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0
Nov 05 04:04:02 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96823b4c-db95-4eb6-8baf-93dc1371d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400e4cee-3b82-462c-ab5b-b0cf5eaff8c7', 'volume_name': 'volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654a46e0-7627-4151-a3b5-e374b906273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654a46e0-7627-4151-a3b5-e374b906273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b94534-a0d8-421b-8de7-2c2a72f1cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:02 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Volume 400e4cee-3b82-462c-ab5b-b0cf5eaff8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7', 'volume_size': 1}
Nov 05 04:04:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:03 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Flow 'volume_create_manager' (3d871aa6-4dec-4c5b-a559-222b7f19b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9171e1df-1e82-44fe-a663-2c21019d8489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0" returned: 0 in 0.440s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:03 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 is being set with open permissions: ugo+rw
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9171e1df-1e82-44fe-a663-2c21019d8489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468a27ebfe6e43ec94c58709deadf43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6889545-c0b2-4795-820e-12254b2a1361,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:03Z,use_quota=True,user_id='5552709376d04fd0af72cdb42bc82190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:03 devstack sudo[108902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0
Nov 05 04:04:03 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc884cdb-5eea-4316-80b3-12caa7237238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc884cdb-5eea-4316-80b3-12caa7237238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645e8a69-3716-41d2-aa50-9fb7083e56a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645e8a69-3716-41d2-aa50-9fb7083e56a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a', 'volume_name': 'volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a', 'volume_size': 1, 'snapshot_id': 'c6889545-c0b2-4795-820e-12254b2a1361'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9699942b-86f1-418e-a82d-512e771cd8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9699942b-86f1-418e-a82d-512e771cd8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb25ff86-e0de-4504-88d2-c3bb8024aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:03 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Volume 6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a', 'volume_size': 1, 'snapshot_id': 'c6889545-c0b2-4795-820e-12254b2a1361'}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:03 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0" returned: 0 in 0.298s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:03 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info
Nov 05 04:04:03 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:03 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info" returned: 0 in 0.309s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:03 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info is being set with open permissions: ugo+rw
Nov 05 04:04:03 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:03 devstack sudo[108908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info
Nov 05 04:04:03 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:04 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.info" returned: 0 in 0.266s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-486936750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400e4cee-3b82-462c-ab5b-b0cf5eaff8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:03Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Creating volume 400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:04 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:04 devstack sudo[108911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 1073741824
Nov 05 04:04:04 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:04 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-afe13f44-0ea8-4804-9a19-ac9d38ac3f60 tempest-ProjectReaderTests-1380422473 None] Create snapshot completed successfully
Nov 05 04:04:04 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 1073741824" returned: 0 in 0.505s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:04 devstack sudo[108922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7
Nov 05 04:04:04 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-2e69e66e-16db-4a0b-a38a-8799a18fafd0-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-2e69e66e-16db-4a0b-a38a-8799a18fafd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-2e69e66e-16db-4a0b-a38a-8799a18fafd0" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-2e69e66e-16db-4a0b-a38a-8799a18fafd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Deleting offline snapshot 2e69e66e-16db-4a0b-a38a-8799a18fafd0 of volume 1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] snapshot_file for this snap is: volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3007e86b-0826-415d-ba23-e9db0646bcd2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:04 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:05 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.721s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-quobyte-c6889545-c0b2-4795-820e-12254b2a1361-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" by "_create_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:05 devstack sudo[108924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0
Nov 05 04:04:05 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b94534-a0d8-421b-8de7-2c2a72f1cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99800845-69fa-4835-8057-2828de527e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-c6889545-c0b2-4795-820e-12254b2a1361-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Creating volume 6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a from snapshot c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-quobyte-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" by "_copy_volume_from_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:05 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Volume volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 (400e4cee-3b82-462c-ab5b-b0cf5eaff8c7): created successfully
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99800845-69fa-4835-8057-2828de527e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (c5075473-bebc-48ec-b149-3425651da141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] snapshot: c6889545-c0b2-4795-820e-12254b2a1361, volume: 6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a,  {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Nov 05 04:04:05 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-726e0cde-a356-41a8-b600-6e0593cd3820 tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[282104bb-7bc6-49ee-8509-f68f6ce6421d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:05 devstack sudo[108927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361
Nov 05 04:04:05 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:05 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0" returned: 0 in 0.465s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c931a28f-2b87-496d-a33a-041f0104d961]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:05 devstack sudo[108932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290
Nov 05 04:04:05 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:05 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a8dac7-44a3-409c-8220-42e16c42b48f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55939e5-2650-4c2a-a99e-7b3bbc2597b4]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:05 devstack sudo[108937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f
Nov 05 04:04:05 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:05 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" returned: 0 in 0.492s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:05 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:06 devstack sudo[108942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0
Nov 05 04:04:06 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:06 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f" returned: 0 in 0.463s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Creating direct copy from snapshot {{(pid=87098) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG cinder.utils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Path /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a not found in is_blk_device check {{(pid=87098) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:06 devstack sudo[108948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a
Nov 05 04:04:06 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:06 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0" returned: 0 in 0.439s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:06 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0
Nov 05 04:04:06 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:06 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290.2e69e66e-16db-4a0b-a38a-8799a18fafd0" returned: 0 in 0.307s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-2e69e66e-16db-4a0b-a38a-8799a18fafd0" released by "_delete_snapshot" :: held 1.844s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" released by "delete_snapshot" :: held 1.875s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:06 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Created reservations ['a2ddcb76-9fc7-43c3-a908-40cf4088086b', '18ec39fd-d2ba-4d7d-9162-58974aa407eb', 'b6b33f2d-37c1-407f-90a1-c42f3e1ae727', '9b56ecef-7cb8-48f9-9273-7dbe5f842774'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:07 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Delete snapshot completed successfully.
Nov 05 04:04:07 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-8895d44e-497f-4490-8fd8-6a1936226ab7 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-2e69e66e-16db-4a0b-a38a-8799a18fafd0-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" acquired by "delete_volume" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0988e1-2d88-4556-88f0-b04a5a91d40c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:08 devstack sudo[108970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:08 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:08 devstack sudo[108969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290
Nov 05 04:04:08 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:09 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.549s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 04:04:09 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" returned: 0 in 0.799s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:09 devstack sudo[108977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290
Nov 05 04:04:09 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:09 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" returned: 0 in 0.452s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290" released by "delete_volume" :: held 1.396s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:09 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Created reservations ['ea7aabec-ab34-4ab7-a560-4319a9276225', 'bfa7c39e-b252-4c85-8c3d-a69347bf68d5', '3d86e4d4-6487-4d7b-940f-bb16e0b6994e', '4d8b2aac-d3be-4470-88df-9c24a8f5eab0'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:10 devstack sudo[108980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:10 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:10 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.371s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:10 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Deleted volume successfully.
Nov 05 04:04:10 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4b61c906-930f-45f6-8704-636a8adabc3d tempest-ProjectReaderTests-1380422473 None] Lock "cinder-1502c7e3-0ce4-4ec8-b1e6-81d74d7c2290-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (7da55480-76cb-49c2-a637-8dbdaa7ba20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ce991-ceb3-4ab0-bd7c-b1b83c234392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ce991-ceb3-4ab0-bd7c-b1b83c234392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39725391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:11Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39113e4-c7d7-435b-94ac-06eafc23fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39113e4-c7d7-435b-94ac-06eafc23fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782fa008-8698-4b8b-8da0-ca9136e6a21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782fa008-8698-4b8b-8da0-ca9136e6a21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c', 'volume_name': 'volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198c9a05-7d09-4ee7-b29d-45688ec34dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198c9a05-7d09-4ee7-b29d-45688ec34dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850650cf-f9a7-4ca0-ab72-b03375d0a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:11 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Volume 3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c', 'volume_size': 1}
Nov 05 04:04:11 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:13 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" returned: 0 in 6.826s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.image.image_utils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Image conversion details: src /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a {{(pid=87098) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Nov 05 04:04:13 devstack cinder-volume[87098]: INFO cinder.image.image_utils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Converted 1024.00 MB image at 149.99 MB/s
Nov 05 04:04:13 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a is being set with open permissions: ugo+rw
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:13 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a
Nov 05 04:04:13 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:13 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" returned: 0 in 0.238s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" released by "_copy_volume_from_snapshot" :: held 8.106s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-c6889545-c0b2-4795-820e-12254b2a1361-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" released by "_create_volume_from_snapshot" :: held 8.197s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.235s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.138s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Creating offline snapshot 4c43baca-bf50-4e42-8caf-2fab458aad35 of volume 400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb25ff86-e0de-4504-88d2-c3bb8024aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a', 'volume_size': 1, 'snapshot_id': 'c6889545-c0b2-4795-820e-12254b2a1361'}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9caa78-75d4-4be2-b030-339118fa4d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2757a6-f595-4cf0-adf4-0ff322f329e8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:13 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Volume volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a (6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a): created successfully
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9caa78-75d4-4be2-b030-339118fa4d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Flow 'volume_create_manager' (3d871aa6-4dec-4c5b-a559-222b7f19b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:13 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-f6158f13-3631-4b03-9afb-7ca826e8b98a tempest-SnapshotDependencyTests-457595757 None] Created volume successfully.
Nov 05 04:04:13 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7
Nov 05 04:04:13 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:13 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:13 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:13 devstack sudo[108991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 1G
Nov 05 04:04:13 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:14 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 1G" returned: 0 in 0.420s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-c6889545-c0b2-4795-820e-12254b2a1361-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:14 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35
Nov 05 04:04:14 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-c6889545-c0b2-4795-820e-12254b2a1361-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-quobyte-88a8dac7-44a3-409c-8220-42e16c42b48f" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-88a8dac7-44a3-409c-8220-42e16c42b48f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-quobyte-c6889545-c0b2-4795-820e-12254b2a1361" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-c6889545-c0b2-4795-820e-12254b2a1361" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Deleting offline snapshot c6889545-c0b2-4795-820e-12254b2a1361 of volume 88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] snapshot_file for this snap is: volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef64e56-5312-4ffe-8bfa-2ebafd3403a7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:14 devstack sudo[108999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361
Nov 05 04:04:14 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:14 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35" returned: 0 in 0.321s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:14 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 is being set with open permissions: ugo+rw
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:14 devstack sudo[109004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35
Nov 05 04:04:14 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:14 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a8dac7-44a3-409c-8220-42e16c42b48f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e0930-7bdc-46ff-b8e8-29c984dd38ab]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:14 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35" returned: 0 in 0.269s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:14 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:14 devstack sudo[109009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f
Nov 05 04:04:14 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:14 devstack sudo[109011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info
Nov 05 04:04:14 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:15 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info" returned: 0 in 0.262s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:15 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info is being set with open permissions: ugo+rw
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:15 devstack sudo[109017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info
Nov 05 04:04:15 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:15 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f" returned: 0 in 0.582s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:15 devstack sudo[109021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361
Nov 05 04:04:15 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:15 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.info" returned: 0 in 0.277s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.679s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-39725391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:11Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Creating volume 3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:15 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:15 devstack sudo[109023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c 1073741824
Nov 05 04:04:15 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:15 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2d3b43f8-e93a-49f6-bfe4-0197dc75e2f6 tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:04:15 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:15 devstack sudo[109031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361
Nov 05 04:04:15 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-4c43baca-bf50-4e42-8caf-2fab458aad35-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Lock "cinder-4c43baca-bf50-4e42-8caf-2fab458aad35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-4c43baca-bf50-4e42-8caf-2fab458aad35" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-4c43baca-bf50-4e42-8caf-2fab458aad35" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot 4c43baca-bf50-4e42-8caf-2fab458aad35 of volume 400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4c7cd4-12ef-4994-bed8-ec3fe4ad6988]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:15 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c 1073741824" returned: 0 in 0.535s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:16 devstack sudo[109034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35
Nov 05 04:04:16 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:16 devstack sudo[109037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c
Nov 05 04:04:16 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:16 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f.c6889545-c0b2-4795-820e-12254b2a1361" returned: 0 in 0.303s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-c6889545-c0b2-4795-820e-12254b2a1361" released by "_delete_snapshot" :: held 1.790s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-88a8dac7-44a3-409c-8220-42e16c42b48f" released by "delete_snapshot" :: held 1.813s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Created reservations ['7467fd89-1827-482d-84c8-741a04718b42', 'd0bf70b5-5a8c-4641-b56a-38b8bee2ced9', 'd86e2333-555a-4112-841d-34d175224441', '432f892d-97be-419d-a5e1-1eebe5ae3c97'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Delete snapshot completed successfully.
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-fbed3cfd-294f-48aa-8fe2-ac5bfcbb291b tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-c6889545-c0b2-4795-820e-12254b2a1361-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:16 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" returned: 0 in 0.297s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:16 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850650cf-f9a7-4ca0-ab72-b03375d0a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449e3f7a-0f1e-4d55-88ad-31b280362d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:16 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Volume volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c (3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c): created successfully
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449e3f7a-0f1e-4d55-88ad-31b280362d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (7da55480-76cb-49c2-a637-8dbdaa7ba20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2657e-3a03-4ea0-b7da-9bec974de8b9]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-88a8dac7-44a3-409c-8220-42e16c42b48f-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:16 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-5885532d-61f2-4e4e-83ac-969df20c1b5c tempest-ProjectReaderTests-1380422473 None] Created volume successfully.
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-88a8dac7-44a3-409c-8220-42e16c42b48f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-quobyte-88a8dac7-44a3-409c-8220-42e16c42b48f" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-88a8dac7-44a3-409c-8220-42e16c42b48f" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:16 devstack sudo[109043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7
Nov 05 04:04:16 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[030def80-fe02-48cd-8e0b-ca8534ad7af8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:16 devstack sudo[109045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f
Nov 05 04:04:16 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:16 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" returned: 0 in 0.456s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:16 devstack sudo[109050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35
Nov 05 04:04:16 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Creating offline snapshot ab73e942-c52f-4df7-a108-996d1945f0ce of volume 3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2cf3f-263a-4169-a208-c53cc5063d45]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:16 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:16 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f" returned: 0 in 0.443s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:17 devstack sudo[109057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f
Nov 05 04:04:17 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:17 devstack sudo[109056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c
Nov 05 04:04:17 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:17 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35" returned: 0 in 0.412s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:17 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-88a8dac7-44a3-409c-8220-42e16c42b48f" returned: 0 in 0.267s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:17 devstack sudo[109064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35
Nov 05 04:04:17 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-88a8dac7-44a3-409c-8220-42e16c42b48f" released by "delete_volume" :: held 0.809s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Created reservations ['c1e7cd1e-4a4b-45cb-b0da-1474367edc1e', '2fd1fdb5-3cee-4631-bce8-cafec0dfaafc', '4042198d-ae4a-4b2e-ae75-a0ff77b33970', '3c7dc78d-6889-4482-b671-4e4ffbf86644'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:17 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:17 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce 1G
Nov 05 04:04:17 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:17 devstack sudo[109070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:17 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:17 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7.4c43baca-bf50-4e42-8caf-2fab458aad35" returned: 0 in 0.308s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-4c43baca-bf50-4e42-8caf-2fab458aad35" released by "_delete_snapshot" :: held 1.760s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" released by "delete_snapshot" :: held 1.800s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Created reservations ['a74c3f11-3c70-4503-9dc2-9ab2d2999e3e', '4b4db39f-d9de-4a80-ae53-5657e7f51ca1', 'e9aaef92-1c43-4301-8438-441345f34922', '54087464-408d-41d1-b646-a72874e086e5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "cinder-quobyte-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:17 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" acquired by "delete_volume" :: waited 0.032s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.347s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac820217-2480-4520-b7e9-0cc81fdf0b4c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Deleted volume successfully.
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-edbb2b88-ccc3-407f-8da6-a0eb5fc80824 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-88a8dac7-44a3-409c-8220-42e16c42b48f-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:04:17 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ec85d216-91b8-4811-bebd-aa4390404742 tempest-ProjectMemberTests-873972974 None] Lock "cinder-4c43baca-bf50-4e42-8caf-2fab458aad35-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:17 devstack sudo[109079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a
Nov 05 04:04:17 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:18 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce 1G" returned: 0 in 0.594s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Lock "cinder-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:18 devstack sudo[109082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce
Nov 05 04:04:18 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=159,cinder:INSERT=58,cinder:UPDATE=197,cinder:DELETE=14 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f090e79-fe9d-4673-bd4f-a6286887fda7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" returned: 0 in 0.451s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack sudo[109088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a
Nov 05 04:04:18 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack sudo[109084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7
Nov 05 04:04:18 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce" returned: 0 in 0.369s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce is being set with open permissions: ugo+rw
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce
Nov 05 04:04:18 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" returned: 0 in 0.273s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-quobyte-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a" released by "delete_volume" :: held 0.780s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:18 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:INSERT=44,cinder:UPDATE=193,cinder:SELECT=171,cinder:DELETE=20 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" returned: 0 in 0.405s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack sudo[109101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7
Nov 05 04:04:18 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Created reservations ['79bee0c1-d968-49ca-8d45-b8b93b8f37fc', '31257721-c68f-44ee-8bc2-413715db6279', '92c73245-7a6f-45aa-90d5-367e66136de2', '2aaa20c3-2f8a-4bb8-9bed-0457064aea5d'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:18 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce" returned: 0 in 0.290s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack sudo[109104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info
Nov 05 04:04:18 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:18 devstack sudo[109106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:18 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:18 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" returned: 0 in 0.322s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:18 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7" released by "delete_volume" :: held 0.842s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Created reservations ['5ebc06b6-bc97-4acc-a459-7c20afb8d442', '5f42cad8-9dbd-40b1-a736-52e8584d21bd', '2379cbad-e59d-49eb-ae24-3a382f988ff2', 'a4ca0fbc-c63d-4b05-89e7-3e8c2e21e387'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:19 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info" returned: 0 in 0.421s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:19 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info is being set with open permissions: ugo+rw
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:19 devstack sudo[109110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:19 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:19 devstack sudo[109113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info
Nov 05 04:04:19 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:19 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Deleted volume successfully.
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-72d1b481-6a72-4e89-b416-f41dd3eab257 tempest-SnapshotDependencyTests-457595757 None] Lock "cinder-6cc2d2d8-e4bb-4db4-986b-3e8ca40c988a-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:19 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b0cfe0ff-eca6-47f5-81cd-b663e3c5ae9d tempest-ProjectMemberTests-873972974 None] Lock "cinder-400e4cee-3b82-462c-ab5b-b0cf5eaff8c7-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:19 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.info" returned: 0 in 0.331s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:19 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-246bc60a-0347-4fad-be02-e6de5f1474b9 tempest-ProjectReaderTests-1380422473 None] Create snapshot completed successfully
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (76d4b5a9-f3fc-4316-9f03-ca7d6889956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1f1b3b-2b38-486a-a34b-c60e6d0bb12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1f1b3b-2b38-486a-a34b-c60e6d0bb12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1386118028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c416599-cd8a-4c20-84ab-47894054ff72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:20Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6569ca5-0c3d-4037-ab56-8c7d9aae80bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6569ca5-0c3d-4037-ab56-8c7d9aae80bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00335e9-b08c-45d1-a3ea-b19c9593a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00335e9-b08c-45d1-a3ea-b19c9593a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c416599-cd8a-4c20-84ab-47894054ff72', 'volume_name': 'volume-7c416599-cd8a-4c20-84ab-47894054ff72', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ef4c6f-406c-45e6-b1cc-2ec9dc61606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ef4c6f-406c-45e6-b1cc-2ec9dc61606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934c42b3-8bb2-4eb2-bcc3-535eadc6bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:19 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Volume 7c416599-cd8a-4c20-84ab-47894054ff72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c416599-cd8a-4c20-84ab-47894054ff72', 'volume_size': 1}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1386118028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c416599-cd8a-4c20-84ab-47894054ff72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:20Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Creating volume 7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:19 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:19 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:20 devstack sudo[109117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 1073741824
Nov 05 04:04:20 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-ab73e942-c52f-4df7-a108-996d1945f0ce-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-ab73e942-c52f-4df7-a108-996d1945f0ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-ab73e942-c52f-4df7-a108-996d1945f0ce" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-ab73e942-c52f-4df7-a108-996d1945f0ce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Deleting offline snapshot ab73e942-c52f-4df7-a108-996d1945f0ce of volume 3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] snapshot_file for this snap is: volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3743bf-dc04-49b4-97d7-6cfdf6dd1611]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:20 devstack sudo[109121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce
Nov 05 04:04:20 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:20 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 1073741824" returned: 0 in 0.545s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:20 devstack sudo[109126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72
Nov 05 04:04:20 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:20 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce" returned: 0 in 0.398s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24497bc-58af-4e7c-95eb-c6fbe6304ce1]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:20 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:20 devstack sudo[109130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c
Nov 05 04:04:20 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72" returned: 0 in 0.292s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934c42b3-8bb2-4eb2-bcc3-535eadc6bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c416599-cd8a-4c20-84ab-47894054ff72', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b1dc7d-5f0a-43f5-b1b5-2bba998cfeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:20 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Volume volume-7c416599-cd8a-4c20-84ab-47894054ff72 (7c416599-cd8a-4c20-84ab-47894054ff72): created successfully
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b1dc7d-5f0a-43f5-b1b5-2bba998cfeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:20 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (76d4b5a9-f3fc-4316-9f03-ca7d6889956d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:20 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d5778b32-0f97-46ba-bd57-55655c09c228 tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:04:21 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" returned: 0 in 0.458s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:21 devstack sudo[109138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce
Nov 05 04:04:21 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:21 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:21 devstack sudo[109143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce
Nov 05 04:04:21 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:21 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c.ab73e942-c52f-4df7-a108-996d1945f0ce" returned: 0 in 0.263s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-ab73e942-c52f-4df7-a108-996d1945f0ce" released by "_delete_snapshot" :: held 1.633s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" released by "delete_snapshot" :: held 1.664s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:21 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Created reservations ['fe1d24ae-5aef-4933-81cc-42690ed95444', '584e1c87-7b31-4378-b895-35ef948516f8', '76e79d88-094b-4027-9a44-93f0fab544b1', '39026860-8a81-4239-80fd-635daf3ad332'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Delete snapshot completed successfully.
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-791fe6c9-fbc2-48e2-a1e9-84a7936129d2 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-ab73e942-c52f-4df7-a108-996d1945f0ce-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Creating offline snapshot c3b92a28-4119-4ce1-916b-173121c32f7f of volume 7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3669fbf4-0c03-4329-8172-a74a7b46e410]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:22 devstack sudo[109146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72
Nov 05 04:04:22 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05f78d-f9d7-49c5-bf85-884275bcd016]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:22 devstack sudo[109148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c
Nov 05 04:04:22 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:22 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72" returned: 0 in 0.450s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:22 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f 1G
Nov 05 04:04:22 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:22 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:22 devstack sudo[109158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c
Nov 05 04:04:22 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:23 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" returned: 0 in 0.277s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c" released by "delete_volume" :: held 0.785s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:23 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f 1G" returned: 0 in 0.548s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c416599-cd8a-4c20-84ab-47894054ff72 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Created reservations ['05acf44b-a8e7-4cb4-8f26-b8d48556543b', '243c746e-9998-4476-b35e-5a8057b145ec', '2cd59643-1bbe-411c-b2d2-f1a596fbfa43', '118679f4-a06e-4ab5-b89b-a1f8ac865916'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:23 devstack sudo[109165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c416599-cd8a-4c20-84ab-47894054ff72 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f
Nov 05 04:04:23 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:23 devstack sudo[109167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:23 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:23 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.279s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:23 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Deleted volume successfully.
Nov 05 04:04:23 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c416599-cd8a-4c20-84ab-47894054ff72 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f" returned: 0 in 0.544s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:23 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f is being set with open permissions: ugo+rw
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-21ffa5a3-8996-400b-8552-5ccec6c9b193 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-3d20ceab-eeb0-4a90-bd9f-a1b88af9f49c-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:23 devstack sudo[109173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f
Nov 05 04:04:23 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:24 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:24 devstack sudo[109176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info
Nov 05 04:04:24 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (9faa6ddd-a7b6-4b5a-b853-63b9665f1049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dea886-1bf1-4933-ba11-611a5107ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dea886-1bf1-4933-ba11-611a5107ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733175920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edd5f12-599c-4ab1-8591-158d92ff7af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:24Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81495bae-7a51-4c53-abb7-179d1c1395cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81495bae-7a51-4c53-abb7-179d1c1395cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04785bfa-dbfd-4e9d-a170-a83e649338e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04785bfa-dbfd-4e9d-a170-a83e649338e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edd5f12-599c-4ab1-8591-158d92ff7af6', 'volume_name': 'volume-8edd5f12-599c-4ab1-8591-158d92ff7af6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d99039-aa8d-4053-9a1d-573a8c6b5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d99039-aa8d-4053-9a1d-573a8c6b5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12426be1-bac7-419c-b2c9-c43e81ce495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Volume 8edd5f12-599c-4ab1-8591-158d92ff7af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edd5f12-599c-4ab1-8591-158d92ff7af6', 'volume_size': 1}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:24 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info" returned: 0 in 0.325s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:24 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info is being set with open permissions: ugo+rw
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:24 devstack sudo[109180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info
Nov 05 04:04:24 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:24 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.info" returned: 0 in 0.307s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733175920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edd5f12-599c-4ab1-8591-158d92ff7af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f2701cf775440fb4258f2fc9313651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:24Z,use_quota=True,user_id='3c97928805054b30866f1a584c3c1f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Creating volume 8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:24 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:24 devstack sudo[109183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 1073741824
Nov 05 04:04:24 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-0f1b6869-a275-4ace-9ca4-01abc19db2ad tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:04:25 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 1073741824" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:25 devstack sudo[109189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6
Nov 05 04:04:25 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-c3b92a28-4119-4ce1-916b-173121c32f7f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Lock "cinder-c3b92a28-4119-4ce1-916b-173121c32f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-7c416599-cd8a-4c20-84ab-47894054ff72" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-7c416599-cd8a-4c20-84ab-47894054ff72" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-c3b92a28-4119-4ce1-916b-173121c32f7f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-c3b92a28-4119-4ce1-916b-173121c32f7f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot c3b92a28-4119-4ce1-916b-173121c32f7f of volume 7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b74a684-b560-41fd-a48b-17e8ecf8a1e2]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:25 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12426be1-bac7-419c-b2c9-c43e81ce495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edd5f12-599c-4ab1-8591-158d92ff7af6', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee588278-f400-4b31-9d7f-6af7c62d2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Volume volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 (8edd5f12-599c-4ab1-8591-158d92ff7af6): created successfully
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee588278-f400-4b31-9d7f-6af7c62d2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Flow 'volume_create_manager' (9faa6ddd-a7b6-4b5a-b853-63b9665f1049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-3486a9ff-30fe-4419-91a2-b63b43250b4b tempest-ProjectReaderTests-1380422473 None] Created volume successfully.
Nov 05 04:04:25 devstack sudo[109192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f
Nov 05 04:04:25 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f" returned: 0 in 0.404s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c416599-cd8a-4c20-84ab-47894054ff72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2066a9-8817-4351-8b36-19a04e194a2e]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack sudo[109197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72
Nov 05 04:04:26 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72" returned: 0 in 0.462s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:26 devstack sudo[109203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f
Nov 05 04:04:26 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Creating offline snapshot 11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 of volume 8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5f0a5-2659-4b87-91e1-e6f3db901d85]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack sudo[109205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6
Nov 05 04:04:26 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:26 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f" returned: 0 in 0.388s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:26 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:26 devstack sudo[109210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f
Nov 05 04:04:26 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:27 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6" returned: 0 in 0.434s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:27 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 1G
Nov 05 04:04:27 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:27 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72.c3b92a28-4119-4ce1-916b-173121c32f7f" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-c3b92a28-4119-4ce1-916b-173121c32f7f" released by "_delete_snapshot" :: held 1.673s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-7c416599-cd8a-4c20-84ab-47894054ff72" released by "delete_snapshot" :: held 1.700s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Created reservations ['c59a5a4d-dd99-4b8e-99c1-22e3409d0dea', '0c85e690-bac4-4345-8ec6-0c14056d5a37', '5e486385-2b96-45c4-b28e-e00b2f1ab972', 'f20fc638-b193-4f4a-b53a-a74391fff508'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:27 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-4691a75f-1b58-4fdc-a613-847ad64bf7a6 tempest-ProjectMemberTests-873972974 None] Lock "cinder-c3b92a28-4119-4ce1-916b-173121c32f7f-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:27 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 1G" returned: 0 in 0.537s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:27 devstack sudo[109222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147
Nov 05 04:04:27 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-7c416599-cd8a-4c20-84ab-47894054ff72-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-7c416599-cd8a-4c20-84ab-47894054ff72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-7c416599-cd8a-4c20-84ab-47894054ff72" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-7c416599-cd8a-4c20-84ab-47894054ff72" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d3e72-96e5-437b-aa77-cb0371b756e7]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:27 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" returned: 0 in 0.380s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:27 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 is being set with open permissions: ugo+rw
Nov 05 04:04:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:27 devstack sudo[109229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147
Nov 05 04:04:27 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:27 devstack sudo[109227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72
Nov 05 04:04:27 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" returned: 0 in 0.257s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:28 devstack sudo[109236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info
Nov 05 04:04:28 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72" returned: 0 in 0.399s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:28 devstack sudo[109238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72
Nov 05 04:04:28 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info" returned: 0 in 0.286s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info is being set with open permissions: ugo+rw
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:28 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack sudo[109242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info
Nov 05 04:04:28 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-7c416599-cd8a-4c20-84ab-47894054ff72" returned: 0 in 0.278s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-7c416599-cd8a-4c20-84ab-47894054ff72" released by "delete_volume" :: held 0.759s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Created reservations ['eaefbf60-def9-4bb5-8573-bab9d4862afe', '5681d2b2-723a-4e94-b5f6-a8d8e960065e', '0a02f7b2-9e02-4b21-ba9f-62957faa3b9e', '3baa7fd3-d346-41aa-840d-2a5a72ba18b3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:28 devstack sudo[109245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:28 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:28 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.info" returned: 0 in 0.357s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-efaf19f5-fb95-4803-82c9-d38388c0bf6d tempest-ProjectReaderTests-1380422473 None] Create snapshot completed successfully
Nov 05 04:04:29 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.323s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:29 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-c3456518-bd21-4a77-88a9-0af4136ccfd2 tempest-ProjectMemberTests-873972974 None] Lock "cinder-7c416599-cd8a-4c20-84ab-47894054ff72-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (233f6d5f-6a15-4540-885e-a58292a86018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10ac97e-4461-4bdd-a2bc-f55b4265776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10ac97e-4461-4bdd-a2bc-f55b4265776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838115856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed2892f-107d-4be3-aa6b-be39b4c2d434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:29Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bc1942-0268-42ef-a47d-e0a2bde789fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bc1942-0268-42ef-a47d-e0a2bde789fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011752cc-7306-4da9-b6bf-f810b22e4cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011752cc-7306-4da9-b6bf-f810b22e4cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed2892f-107d-4be3-aa6b-be39b4c2d434', 'volume_name': 'volume-fed2892f-107d-4be3-aa6b-be39b4c2d434', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e242e0da-53e3-44eb-92d8-e200ac5cd6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e242e0da-53e3-44eb-92d8-e200ac5cd6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71703cf7-73a8-4201-9739-b47e1489e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:29 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Volume fed2892f-107d-4be3-aa6b-be39b4c2d434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed2892f-107d-4be3-aa6b-be39b4c2d434', 'volume_size': 1}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838115856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed2892f-107d-4be3-aa6b-be39b4c2d434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:29Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Creating volume fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:29 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:29 devstack sudo[109248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 1073741824
Nov 05 04:04:29 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-8edd5f12-599c-4ab1-8591-158d92ff7af6" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-8edd5f12-599c-4ab1-8591-158d92ff7af6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Deleting offline snapshot 11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 of volume 8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] snapshot_file for this snap is: volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d78448-6e5e-4308-b266-f18d9ef6ba2c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:29 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:30 devstack sudo[109254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147
Nov 05 04:04:30 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:30 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 1073741824" returned: 0 in 0.602s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:30 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434
Nov 05 04:04:30 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:30 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" returned: 0 in 0.469s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8edd5f12-599c-4ab1-8591-158d92ff7af6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c60e1b-1f65-48d4-90e3-42ca6a175f1f]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:30 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434" returned: 0 in 0.296s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71703cf7-73a8-4201-9739-b47e1489e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed2892f-107d-4be3-aa6b-be39b4c2d434', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb42cca-c070-4aff-8aad-be4802465de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:30 devstack sudo[109262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6
Nov 05 04:04:30 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:30 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Volume volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 (fed2892f-107d-4be3-aa6b-be39b4c2d434): created successfully
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb42cca-c070-4aff-8aad-be4802465de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (233f6d5f-6a15-4540-885e-a58292a86018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:30 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-aace45ec-587c-4301-94ce-b326523e4d5a tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:04:30 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6" returned: 0 in 0.472s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:30 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:30 devstack sudo[109269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147
Nov 05 04:04:30 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:31 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" returned: 0 in 0.415s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:31 devstack sudo[109274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147
Nov 05 04:04:31 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:31 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6.11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" returned: 0 in 0.291s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147" released by "_delete_snapshot" :: held 1.815s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-8edd5f12-599c-4ab1-8591-158d92ff7af6" released by "delete_snapshot" :: held 1.850s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Created reservations ['ecd8f3f1-4c05-4b93-949f-249df0c0d1a4', '6961311a-f9ce-4c73-9d1d-1add5b28eac1', 'ce22e091-4518-446d-b54a-48827e83d315', '053a8cd7-b73e-4910-8b38-4f710178181a'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Creating offline snapshot 6ea94cf7-0e81-4de5-9933-86db54e79c94 of volume fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdf5939-5f8b-4722-ae4b-bf5919526917]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:31 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:32 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Delete snapshot completed successfully.
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d2ba77ae-be9d-4c43-86ae-96fd86dd7098 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-11c8e98a-7b6b-4ee7-8ec8-9588ad6d2147-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-8edd5f12-599c-4ab1-8591-158d92ff7af6-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-8edd5f12-599c-4ab1-8591-158d92ff7af6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:32 devstack sudo[109277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434
Nov 05 04:04:32 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "cinder-quobyte-8edd5f12-599c-4ab1-8591-158d92ff7af6" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-8edd5f12-599c-4ab1-8591-158d92ff7af6" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b9d17-9a72-4579-9da0-0f33eaacca22]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:32 devstack sudo[109279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6
Nov 05 04:04:32 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:32 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434" returned: 0 in 0.486s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:32 devstack sudo[109284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 1G
Nov 05 04:04:32 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:32 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6" returned: 0 in 0.455s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:32 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6
Nov 05 04:04:32 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:32 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 1G" returned: 0 in 0.489s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:32 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:32 devstack sudo[109296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94
Nov 05 04:04:32 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:33 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-8edd5f12-599c-4ab1-8591-158d92ff7af6" returned: 0 in 0.316s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-quobyte-8edd5f12-599c-4ab1-8591-158d92ff7af6" released by "delete_volume" :: held 0.851s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Created reservations ['aa613029-12ef-4b5b-8378-783be50f2377', '65bda088-6d04-4391-b350-d2f46ffa1110', 'e82d73d9-c2c0-4a66-afc1-eeaa95c1552f', '92615d05-f87b-4b08-99ab-e757cba8c05b'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:33 devstack sudo[109298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:33 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:33 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94" returned: 0 in 0.377s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:33 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 is being set with open permissions: ugo+rw
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:33 devstack sudo[109303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94
Nov 05 04:04:33 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:33 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.306s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:33 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Deleted volume successfully.
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-dd768e1b-015a-4ab4-bd47-9060c3f6a190 tempest-ProjectReaderTests-1380422473 None] Lock "cinder-8edd5f12-599c-4ab1-8591-158d92ff7af6-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:33 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94" returned: 0 in 0.305s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:33 devstack sudo[109307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info
Nov 05 04:04:33 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:33 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info" returned: 0 in 0.318s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:33 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info is being set with open permissions: ugo+rw
Nov 05 04:04:33 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:34 devstack sudo[109310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info
Nov 05 04:04:34 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:34 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.info" returned: 0 in 0.279s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:34 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:34 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-de365388-d389-4528-bd58-68bd5fe45efe tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-6ea94cf7-0e81-4de5-9933-86db54e79c94-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Lock "cinder-6ea94cf7-0e81-4de5-9933-86db54e79c94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-fed2892f-107d-4be3-aa6b-be39b4c2d434" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fed2892f-107d-4be3-aa6b-be39b4c2d434" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-6ea94cf7-0e81-4de5-9933-86db54e79c94" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-6ea94cf7-0e81-4de5-9933-86db54e79c94" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot 6ea94cf7-0e81-4de5-9933-86db54e79c94 of volume fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10a7304-7d3c-496f-bc97-005e08b264fb]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:35 devstack sudo[109313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94
Nov 05 04:04:35 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:35 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94" returned: 0 in 0.373s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fed2892f-107d-4be3-aa6b-be39b4c2d434(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f0ef23-120b-40d4-a101-e9e867fc287d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:35 devstack sudo[109318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434
Nov 05 04:04:35 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:35 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434" returned: 0 in 0.418s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:35 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:36 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94
Nov 05 04:04:36 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:36 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:36 devstack sudo[109331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94
Nov 05 04:04:36 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:36 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434.6ea94cf7-0e81-4de5-9933-86db54e79c94" returned: 0 in 0.288s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-6ea94cf7-0e81-4de5-9933-86db54e79c94" released by "_delete_snapshot" :: held 1.587s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fed2892f-107d-4be3-aa6b-be39b4c2d434" released by "delete_snapshot" :: held 1.614s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Created reservations ['e53e381c-f2b6-49ee-8af7-0be14496e3de', 'd60fb7be-032f-42c0-b8a5-a6d8b03f77aa', '9e0fd4f4-bf1c-4884-9a79-86fdd4112b5c', '140be6e3-f92e-4332-8e4f-01b2462553a3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:36 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:04:36 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-da9c3cc4-94ca-4fde-b289-e09e354af2d5 tempest-ProjectMemberTests-873972974 None] Lock "cinder-6ea94cf7-0e81-4de5-9933-86db54e79c94-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-fed2892f-107d-4be3-aa6b-be39b4c2d434-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Lock "cinder-fed2892f-107d-4be3-aa6b-be39b4c2d434-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-fed2892f-107d-4be3-aa6b-be39b4c2d434" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fed2892f-107d-4be3-aa6b-be39b4c2d434" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed814b-faa8-4ef2-8210-d3574c48f2c0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:37 devstack sudo[109334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434
Nov 05 04:04:37 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:37 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434" returned: 0 in 0.431s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:37 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:37 devstack sudo[109340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434
Nov 05 04:04:37 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:38 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-fed2892f-107d-4be3-aa6b-be39b4c2d434" returned: 0 in 0.282s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-fed2892f-107d-4be3-aa6b-be39b4c2d434" released by "delete_volume" :: held 0.795s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Created reservations ['59c77ca6-8a4d-41f1-b7ca-99a0ccf5aa8c', '38cb2ffe-3dac-4dc3-aaf4-d0335098b482', 'bfe6b4e4-53e2-4921-ad2f-7e130a59ecae', 'e00e0e4f-89af-45ee-b54c-3a74914f5d3c'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:38 devstack sudo[109343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:38 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:38 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.269s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:38 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:04:38 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-033c5db3-0a1b-49c5-8f01-349e4c5c3a38 tempest-ProjectMemberTests-873972974 None] Lock "cinder-fed2892f-107d-4be3-aa6b-be39b4c2d434-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (57a578b6-e8b3-4851-a9d5-910ea24faa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d91bce-0eee-497b-9144-938f03f653ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d91bce-0eee-497b-9144-938f03f653ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037575940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f8270e-450c-4119-b87f-a53c0846a3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:39Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64d4372-0b01-48fa-8bda-1e4015ec4658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64d4372-0b01-48fa-8bda-1e4015ec4658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4c029b-6c9a-4556-b2d9-5fa812f843ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4c029b-6c9a-4556-b2d9-5fa812f843ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f8270e-450c-4119-b87f-a53c0846a3b2', 'volume_name': 'volume-87f8270e-450c-4119-b87f-a53c0846a3b2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20cd4dd-c2c6-4d75-a5de-f21afb448867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20cd4dd-c2c6-4d75-a5de-f21afb448867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d0a5a9-c25a-4a38-8256-74beec5891a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Volume 87f8270e-450c-4119-b87f-a53c0846a3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f8270e-450c-4119-b87f-a53c0846a3b2', 'volume_size': 1}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037575940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f8270e-450c-4119-b87f-a53c0846a3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:39Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Creating volume 87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:39 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:39 devstack sudo[109346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 1073741824
Nov 05 04:04:39 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:39 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 1073741824" returned: 0 in 0.460s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:39 devstack sudo[109352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2
Nov 05 04:04:39 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:39 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d0a5a9-c25a-4a38-8256-74beec5891a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f8270e-450c-4119-b87f-a53c0846a3b2', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884aee28-fdd4-481a-a23a-b952b8663ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:39 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Volume volume-87f8270e-450c-4119-b87f-a53c0846a3b2 (87f8270e-450c-4119-b87f-a53c0846a3b2): created successfully
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884aee28-fdd4-481a-a23a-b952b8663ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:39 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (57a578b6-e8b3-4851-a9d5-910ea24faa8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:39 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b0514c4c-f155-43b2-a885-2c380c850cbb tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Creating offline snapshot 29e64436-1a6d-4579-9d3e-017586722813 of volume 87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a004bf-7f2f-49d9-ab4c-2464a105e549]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:41 devstack sudo[109358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2
Nov 05 04:04:41 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:41 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2" returned: 0 in 0.423s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:41 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:41 devstack sudo[109363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 1G
Nov 05 04:04:41 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:42 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 1G" returned: 0 in 0.464s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f8270e-450c-4119-b87f-a53c0846a3b2 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:42 devstack sudo[109369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f8270e-450c-4119-b87f-a53c0846a3b2 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813
Nov 05 04:04:42 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:42 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f8270e-450c-4119-b87f-a53c0846a3b2 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813" returned: 0 in 0.340s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:42 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 is being set with open permissions: ugo+rw
Nov 05 04:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:42 devstack sudo[109374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813
Nov 05 04:04:42 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:42 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813" returned: 0 in 0.259s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:42 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:42 devstack sudo[109377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info
Nov 05 04:04:42 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:43 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info" returned: 0 in 0.284s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:43 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info is being set with open permissions: ugo+rw
Nov 05 04:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:43 devstack sudo[109380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info
Nov 05 04:04:43 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:43 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.info" returned: 0 in 0.280s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:43 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:43 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ae7ca26a-10e0-47ae-9375-91b596ed4ae5 tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-29e64436-1a6d-4579-9d3e-017586722813-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Lock "cinder-29e64436-1a6d-4579-9d3e-017586722813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-87f8270e-450c-4119-b87f-a53c0846a3b2" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-87f8270e-450c-4119-b87f-a53c0846a3b2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-29e64436-1a6d-4579-9d3e-017586722813" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-29e64436-1a6d-4579-9d3e-017586722813" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot 29e64436-1a6d-4579-9d3e-017586722813 of volume 87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ef7e4-69a6-4a30-8727-b2c27afa6cb0]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:44 devstack sudo[109383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813
Nov 05 04:04:44 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:44 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813" returned: 0 in 0.395s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f8270e-450c-4119-b87f-a53c0846a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4c942-e473-4d44-8fcf-521205918695]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:44 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:45 devstack sudo[109389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2
Nov 05 04:04:45 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:45 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2" returned: 0 in 0.380s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:45 devstack sudo[109394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813
Nov 05 04:04:45 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:45 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813" returned: 0 in 0.333s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:45 devstack sudo[109399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813
Nov 05 04:04:45 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:45 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2.29e64436-1a6d-4579-9d3e-017586722813" returned: 0 in 0.271s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-29e64436-1a6d-4579-9d3e-017586722813" released by "_delete_snapshot" :: held 1.483s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:45 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-87f8270e-450c-4119-b87f-a53c0846a3b2" released by "delete_snapshot" :: held 1.508s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Created reservations ['0d238ecd-5692-4bfb-be76-29891859e1f4', '8b0aa336-3f5f-45bb-b2f8-1fda4c083546', '6796bbd6-3db5-4e40-8fa3-a51aa9c4462d', '78a30590-f06d-457a-8c2c-a23fe24f25ff'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:46 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-ffab9918-9294-4476-a19a-cd7e327c90ea tempest-ProjectMemberTests-873972974 None] Lock "cinder-29e64436-1a6d-4579-9d3e-017586722813-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-87f8270e-450c-4119-b87f-a53c0846a3b2-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Lock "cinder-87f8270e-450c-4119-b87f-a53c0846a3b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-87f8270e-450c-4119-b87f-a53c0846a3b2" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-87f8270e-450c-4119-b87f-a53c0846a3b2" acquired by "delete_volume" :: waited 0.014s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf501b6-e050-4651-a3ca-47da09d616bf]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:46 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:46 devstack sudo[109402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2
Nov 05 04:04:46 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:47 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2" returned: 0 in 0.394s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:47 devstack sudo[109407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2
Nov 05 04:04:47 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:47 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-87f8270e-450c-4119-b87f-a53c0846a3b2" returned: 0 in 0.260s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-87f8270e-450c-4119-b87f-a53c0846a3b2" released by "delete_volume" :: held 0.718s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Created reservations ['4574946e-88a2-402a-8471-8d53e88e6e5b', '5395a45e-3eb0-49e0-9221-201f890a74d1', '215852aa-338f-4cfd-8820-88281732f4a8', '9a8773eb-76d7-49a8-bb64-69a1d0b8f9fb'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:47 devstack sudo[109410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:47 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:47 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.262s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:47 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:04:47 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-d7ace4ab-c620-4295-b8bb-b79571d001c8 tempest-ProjectMemberTests-873972974 None] Lock "cinder-87f8270e-450c-4119-b87f-a53c0846a3b2-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (23a8135e-b172-4be7-aaa3-f06f12cb1e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ffab5-3d1c-49f7-82e8-7d7da4711b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ffab5-3d1c-49f7-82e8-7d7da4711b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527127654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e931d4b7-99cb-49c8-917c-efcd93611f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:48Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3b4067-a655-4718-afdc-0f85a8bff786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3b4067-a655-4718-afdc-0f85a8bff786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e691a8c-a1cc-47b2-8031-047a113c6dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e691a8c-a1cc-47b2-8031-047a113c6dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e931d4b7-99cb-49c8-917c-efcd93611f5d', 'volume_name': 'volume-e931d4b7-99cb-49c8-917c-efcd93611f5d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c3cb44-0c32-43bb-8830-8d5e47457344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c3cb44-0c32-43bb-8830-8d5e47457344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4c1f0b-2ef3-407a-afea-743d870113e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:48 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Volume e931d4b7-99cb-49c8-917c-efcd93611f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e931d4b7-99cb-49c8-917c-efcd93611f5d', 'volume_size': 1}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527127654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e931d4b7-99cb-49c8-917c-efcd93611f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:48Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Creating volume e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:48 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:48 devstack sudo[109414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d 1073741824
Nov 05 04:04:48 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:48 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d 1073741824" returned: 0 in 0.432s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:48 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:48 devstack sudo[109419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d
Nov 05 04:04:48 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:49 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d" returned: 0 in 0.271s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4c1f0b-2ef3-407a-afea-743d870113e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e931d4b7-99cb-49c8-917c-efcd93611f5d', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee61f30f-4705-4e39-96fd-60853953e12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:49 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Volume volume-e931d4b7-99cb-49c8-917c-efcd93611f5d (e931d4b7-99cb-49c8-917c-efcd93611f5d): created successfully
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee61f30f-4705-4e39-96fd-60853953e12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (23a8135e-b172-4be7-aaa3-f06f12cb1e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:49 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-544026b3-4c71-4cca-983d-d7af872de49c tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Creating offline snapshot c510e5b9-3d3f-46e0-b999-59fd1acd0617 of volume e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d99b2d5-6147-4cf1-9a9b-18f70b9184df]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:49 devstack sudo[109422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d
Nov 05 04:04:49 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:49 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d" returned: 0 in 0.378s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:49 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:49 devstack sudo[109427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 1G
Nov 05 04:04:49 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:50 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 1G" returned: 0 in 0.413s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e931d4b7-99cb-49c8-917c-efcd93611f5d -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:50 devstack sudo[109432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e931d4b7-99cb-49c8-917c-efcd93611f5d -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617
Nov 05 04:04:50 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:50 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e931d4b7-99cb-49c8-917c-efcd93611f5d -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617" returned: 0 in 0.286s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:50 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 is being set with open permissions: ugo+rw
Nov 05 04:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:50 devstack sudo[109437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617
Nov 05 04:04:50 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:50 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:50 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:50 devstack sudo[109440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info
Nov 05 04:04:50 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:51 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info" returned: 0 in 0.249s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:51 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info is being set with open permissions: ugo+rw
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:51 devstack sudo[109443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info
Nov 05 04:04:51 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:51 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.info" returned: 0 in 0.256s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:51 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b47e781c-91d7-4ecc-8ce6-d2a3526b1047 tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-c510e5b9-3d3f-46e0-b999-59fd1acd0617-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Lock "cinder-c510e5b9-3d3f-46e0-b999-59fd1acd0617-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-e931d4b7-99cb-49c8-917c-efcd93611f5d" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-e931d4b7-99cb-49c8-917c-efcd93611f5d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-c510e5b9-3d3f-46e0-b999-59fd1acd0617" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-c510e5b9-3d3f-46e0-b999-59fd1acd0617" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot c510e5b9-3d3f-46e0-b999-59fd1acd0617 of volume e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a854fc-8cf0-4e4a-849e-d68386149332]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:51 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:51 devstack sudo[109446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617
Nov 05 04:04:51 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:52 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617" returned: 0 in 0.356s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e931d4b7-99cb-49c8-917c-efcd93611f5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[d697328a-0249-474a-84d8-6f42df01290c]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:52 devstack sudo[109451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d
Nov 05 04:04:52 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:52 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d" returned: 0 in 0.358s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:52 devstack sudo[109456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617
Nov 05 04:04:52 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:52 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617" returned: 0 in 0.339s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:52 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:52 devstack sudo[109461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617
Nov 05 04:04:52 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:53 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d.c510e5b9-3d3f-46e0-b999-59fd1acd0617" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-c510e5b9-3d3f-46e0-b999-59fd1acd0617" released by "_delete_snapshot" :: held 1.392s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-e931d4b7-99cb-49c8-917c-efcd93611f5d" released by "delete_snapshot" :: held 1.415s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Created reservations ['5921a8e0-e597-4d01-8386-6871cfc32a58', 'e3a9d46e-50de-41d0-bad8-847fe02e9e0b', '18aeefd0-fc8f-4b4d-8037-79657faea69c', '5920485e-4e99-47cb-a02c-566db4311529'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:53 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-7026568c-833a-44c9-a63b-4ed6b8e28c19 tempest-ProjectMemberTests-873972974 None] Lock "cinder-c510e5b9-3d3f-46e0-b999-59fd1acd0617-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-e931d4b7-99cb-49c8-917c-efcd93611f5d-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-e931d4b7-99cb-49c8-917c-efcd93611f5d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-e931d4b7-99cb-49c8-917c-efcd93611f5d" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-e931d4b7-99cb-49c8-917c-efcd93611f5d" acquired by "delete_volume" :: waited 0.012s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a57b58-7fd6-4f07-a7ab-086e2808d15d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:53 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:53 devstack sudo[109464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d
Nov 05 04:04:53 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:54 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d" returned: 0 in 0.352s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:54 devstack sudo[109469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d
Nov 05 04:04:54 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:54 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-e931d4b7-99cb-49c8-917c-efcd93611f5d" returned: 0 in 0.245s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-e931d4b7-99cb-49c8-917c-efcd93611f5d" released by "delete_volume" :: held 0.657s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Created reservations ['a0adeeb7-a676-474b-82c0-2e315ca01b22', '69a94710-0d07-494e-8edf-37cdc1bb5930', '754c3f1b-754e-4041-a728-b3ed9f60578a', 'd15c6205-310c-4f8f-85a6-67585ae67108'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:54 devstack sudo[109473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:04:54 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:54 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.265s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:04:54 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:04:54 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9ebf42db-044a-4e3d-b1f2-c5dbb3030da0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-e931d4b7-99cb-49c8-917c-efcd93611f5d-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (36f0ef53-5160-42db-b687-c3d4b3a44761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1391ae8-66ad-4153-9812-70c130b79f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1391ae8-66ad-4153-9812-70c130b79f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467789143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca278c8-b7e9-461b-8ac7-427d76ca7f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:55Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae14c80-7142-4c5e-acac-6519fdf11a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae14c80-7142-4c5e-acac-6519fdf11a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dbe058-1364-44e7-b443-f58fd36cccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dbe058-1364-44e7-b443-f58fd36cccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca278c8-b7e9-461b-8ac7-427d76ca7f85', 'volume_name': 'volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee26be6-6f95-4e3d-a79e-60f6d6f4dfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee26be6-6f95-4e3d-a79e-60f6d6f4dfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a921f6-aad2-46a2-ae44-e4dbf1c71957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:55 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Volume dca278c8-b7e9-461b-8ac7-427d76ca7f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85', 'volume_size': 1}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467789143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca278c8-b7e9-461b-8ac7-427d76ca7f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2cf0302a5a495db5d1bdee11f317b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:55Z,use_quota=True,user_id='ce43fa3a08374e6b8d057cbdd0c303ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Creating volume dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:04:55 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:55 devstack sudo[109476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 1073741824
Nov 05 04:04:55 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:55 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 1073741824" returned: 0 in 0.426s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:55 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:55 devstack sudo[109482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85
Nov 05 04:04:55 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:56 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85" returned: 0 in 0.240s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a921f6-aad2-46a2-ae44-e4dbf1c71957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64061a55-596f-4ac4-a4fc-78be63f6b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:04:56 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Volume volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 (dca278c8-b7e9-461b-8ac7-427d76ca7f85): created successfully
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64061a55-596f-4ac4-a4fc-78be63f6b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Flow 'volume_create_manager' (36f0ef53-5160-42db-b687-c3d4b3a44761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:04:56 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2858e984-a90c-4cc1-82cf-5b115f8ba8a3 tempest-ProjectMemberTests-873972974 None] Created volume successfully.
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Creating offline snapshot 60a6febd-598d-49df-9564-56b957606c5f of volume dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a941527-184a-4f16-971d-f134aebf4510]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:56 devstack sudo[109485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85
Nov 05 04:04:56 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:56 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85" returned: 0 in 0.386s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:56 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f 1G {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:56 devstack sudo[109491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f 1G
Nov 05 04:04:56 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:57 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f 1G" returned: 0 in 0.384s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:57 devstack sudo[109497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f
Nov 05 04:04:57 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:57 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 -F qcow2 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f" returned: 0 in 0.317s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:57 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f is being set with open permissions: ugo+rw
Nov 05 04:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:57 devstack sudo[109503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f
Nov 05 04:04:57 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:57 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f" returned: 0 in 0.248s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:57 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:57 devstack sudo[109506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info
Nov 05 04:04:57 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:58 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info" returned: 0 in 0.263s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:58 devstack cinder-volume[87098]: WARNING cinder.volume.drivers.remotefs [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info is being set with open permissions: ugo+rw
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:58 devstack sudo[109509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info
Nov 05 04:04:58 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:58 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.info" returned: 0 in 0.247s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:04:58 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-a5bc3781-e77f-402c-af33-b15d873348d9 tempest-ProjectMemberTests-873972974 None] Create snapshot completed successfully
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-60a6febd-598d-49df-9564-56b957606c5f-delete_snapshot" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-60a6febd-598d-49df-9564-56b957606c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-dca278c8-b7e9-461b-8ac7-427d76ca7f85" by "delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-dca278c8-b7e9-461b-8ac7-427d76ca7f85" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-60a6febd-598d-49df-9564-56b957606c5f" by "_delete_snapshot" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-60a6febd-598d-49df-9564-56b957606c5f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Deleting offline snapshot 60a6febd-598d-49df-9564-56b957606c5f of volume dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] snapshot_file for this snap is: volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f {{(pid=87098) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122a448-4413-4e23-9111-b4cbdeb16fc3]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:58 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:58 devstack sudo[109512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f
Nov 05 04:04:58 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:59 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87098) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52bf61-bfe1-43e2-a45b-e5d86130e6a8]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:59 devstack sudo[109517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85
Nov 05 04:04:59 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:59 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85" returned: 0 in 0.375s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:04:59 devstack sudo[109522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f
Nov 05 04:04:59 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:04:59 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f" returned: 0 in 0.368s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:04:59 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:00 devstack sudo[109527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f
Nov 05 04:05:00 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:00 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85.60a6febd-598d-49df-9564-56b957606c5f" returned: 0 in 0.262s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-60a6febd-598d-49df-9564-56b957606c5f" released by "_delete_snapshot" :: held 1.491s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-dca278c8-b7e9-461b-8ac7-427d76ca7f85" released by "delete_snapshot" :: held 1.514s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Created reservations ['ca99dd06-39cf-471e-a2bf-ad85dd2958d5', '582574ee-d3e0-4e32-8d5c-85e1d1dd5305', 'dac01121-af0a-4a76-99bc-1a896e8ae198', '1c6f9852-5459-404f-bba8-4cb96377a5c1'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:05:00 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Delete snapshot completed successfully.
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-2052a927-e0d0-425c-b069-449c6c79ccb0 tempest-ProjectMemberTests-873972974 None] Lock "cinder-60a6febd-598d-49df-9564-56b957606c5f-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-dca278c8-b7e9-461b-8ac7-427d76ca7f85-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Lock "cinder-dca278c8-b7e9-461b-8ac7-427d76ca7f85-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Acquiring lock "cinder-quobyte-dca278c8-b7e9-461b-8ac7-427d76ca7f85" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:05:00 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-dca278c8-b7e9-461b-8ac7-427d76ca7f85" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[9782362b-54f2-43d6-97ae-a4f4342c598d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:01 devstack sudo[109531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85
Nov 05 04:05:01 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:01 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85" returned: 0 in 0.361s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:01 devstack sudo[109536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85
Nov 05 04:05:01 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:01 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-dca278c8-b7e9-461b-8ac7-427d76ca7f85" returned: 0 in 0.244s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Lock "cinder-quobyte-dca278c8-b7e9-461b-8ac7-427d76ca7f85" released by "delete_volume" :: held 0.665s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Created reservations ['98b282e7-5090-4f50-abf4-2971c76050c1', 'b864558e-709d-4310-bb8e-c623156d058e', '70192e2e-4999-49f7-8ee7-47e099d1865e', '44e8399c-4fce-4136-9d87-c601280d738f'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:01 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:01 devstack sudo[109542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:05:01 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:02 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:02 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.272s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:02 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:05:02 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Deleted volume successfully.
Nov 05 04:05:02 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-9284a9fc-ee0c-4b3c-8658-4a2f672e5b2f tempest-ProjectMemberTests-873972974 None] Lock "cinder-dca278c8-b7e9-461b-8ac7-427d76ca7f85-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:08 devstack sudo[109591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:05:08 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:08 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-595f047e-17fc-4c28-90e0-369737569cca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.269s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG oslo_service.periodic_task [None req-595f047e-17fc-4c28-90e0-369737569cca None None] Running periodic task VolumeManager._thread_info {{(pid=87098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread count: 28 {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}}
Nov 05 04:05:08 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-595f047e-17fc-4c28-90e0-369737569cca None None] thread info: [<_MainThread(MainThread, started 127230831464576)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127230722313216)>, <Thread(Thread-3 (stat_writer), started daemon 127230716398656)>, <Thread(Rabbit-heartbeat, started daemon 127230717175168)>, <Thread(Thread-5 (_runner), started daemon 127230715195136)>, <Thread(Thread-7 (_runner), started daemon 127230715264576)>, <Thread(fd_logger, started daemon 127230714813376)>, <Thread(privsep_reader, started daemon 127230712977536)>, <Thread(tpool_thread_0, started daemon 127230704412352)>, <Thread(tpool_thread_1, started daemon 127230696019648)>, <Thread(tpool_thread_2, started daemon 127230687626944)>, <Thread(tpool_thread_3, started daemon 127230679234240)>, <Thread(tpool_thread_4, started daemon 127230670841536)>, <Thread(tpool_thread_5, started daemon 127230662448832)>, <Thread(tpool_thread_6, started daemon 127230654056128)>, <Thread(tpool_thread_7, started daemon 127230645663424)>, <Thread(tpool_thread_8, started daemon 127230637270720)>, <Thread(tpool_thread_9, started daemon 127230628878016)>, <Thread(tpool_thread_10, started daemon 127230620485312)>, <Thread(tpool_thread_11, started daemon 127230612076224)>, <Thread(tpool_thread_12, started daemon 127230603667136)>, <Thread(tpool_thread_13, started daemon 127230595258048)>, <Thread(tpool_thread_14, started daemon 127230586848960)>, <Thread(tpool_thread_15, started daemon 127230578439872)>, <Thread(tpool_thread_16, started daemon 127230570030784)>, <Thread(tpool_thread_17, started daemon 127230561621696)>, <Thread(tpool_thread_18, started daemon 127230553212608)>, <Thread(tpool_thread_19, started daemon 127230544803520)>] {{(pid=87098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}
Nov 05 04:05:11 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:INSERT=41,cinder:UPDATE=150,cinder:SELECT=107,cinder:DELETE=13 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:05:12 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=112,cinder:INSERT=36,cinder:UPDATE=125,cinder:DELETE=9 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Flow 'volume_create_manager' (efa71c00-8016-40c1-b2bb-939bb9b70117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262933bd-29b3-49b3-94d8-b120fa56f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262933bd-29b3-49b3-94d8-b120fa56f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095799847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727c6176-d80a-403b-b2f6-f9a79c7637bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d8a868b9584223b52a756e4c3d13e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:22Z,use_quota=True,user_id='25fbf6d08bd547acbb7fd019dd2db89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef17b323-9d12-4a37-b650-e47840ff3806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef17b323-9d12-4a37-b650-e47840ff3806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79aebed0-6d00-4321-83d4-0ac18f2c6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79aebed0-6d00-4321-83d4-0ac18f2c6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727c6176-d80a-403b-b2f6-f9a79c7637bd', 'volume_name': 'volume-727c6176-d80a-403b-b2f6-f9a79c7637bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a46e212-2381-4712-a941-d5c5666a198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a46e212-2381-4712-a941-d5c5666a198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87b9492-5de7-4510-814b-8892046f3aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:21 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Volume 727c6176-d80a-403b-b2f6-f9a79c7637bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727c6176-d80a-403b-b2f6-f9a79c7637bd', 'volume_size': 1}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095799847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727c6176-d80a-403b-b2f6-f9a79c7637bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d8a868b9584223b52a756e4c3d13e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:22Z,use_quota=True,user_id='25fbf6d08bd547acbb7fd019dd2db89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Creating volume 727c6176-d80a-403b-b2f6-f9a79c7637bd {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:05:21 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:05:21 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:22 devstack sudo[109595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd 1073741824
Nov 05 04:05:22 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:22 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd 1073741824" returned: 0 in 0.467s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:22 devstack sudo[109601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd
Nov 05 04:05:22 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:22 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd" returned: 0 in 0.276s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87b9492-5de7-4510-814b-8892046f3aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727c6176-d80a-403b-b2f6-f9a79c7637bd', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b043b24-4ac8-487b-8572-48ebb1e8d8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:22 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Volume volume-727c6176-d80a-403b-b2f6-f9a79c7637bd (727c6176-d80a-403b-b2f6-f9a79c7637bd): created successfully
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b043b24-4ac8-487b-8572-48ebb1e8d8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:22 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Flow 'volume_create_manager' (efa71c00-8016-40c1-b2bb-939bb9b70117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:05:22 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-6df2c30d-8832-4039-8e1a-72ba3ad2eb69 tempest-ProjectReaderTests-722010951 None] Created volume successfully.
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Acquiring lock "cinder-727c6176-d80a-403b-b2f6-f9a79c7637bd-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Lock "cinder-727c6176-d80a-403b-b2f6-f9a79c7637bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Acquiring lock "cinder-quobyte-727c6176-d80a-403b-b2f6-f9a79c7637bd" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Lock "cinder-quobyte-727c6176-d80a-403b-b2f6-f9a79c7637bd" acquired by "delete_volume" :: waited 0.020s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c97d2-03b8-4834-8769-f242b7f4517d]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:23 devstack sudo[109604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd
Nov 05 04:05:23 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:23 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd" returned: 0 in 0.397s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:23 devstack sudo[109609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd
Nov 05 04:05:23 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:23 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-727c6176-d80a-403b-b2f6-f9a79c7637bd" returned: 0 in 0.262s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Lock "cinder-quobyte-727c6176-d80a-403b-b2f6-f9a79c7637bd" released by "delete_volume" :: held 0.710s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:23 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Created reservations ['ac4fb0a1-87e6-4ed0-a4e0-8a63c399ef6f', 'dad3d265-d835-4db6-83ff-7d8eb4884a52', 'b3c9418e-c685-45de-9aef-499787753e32', 'f8ba5513-6162-4c0c-818c-c1a8d4ed55d3'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:24 devstack sudo[109612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:05:24 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:24 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.299s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:05:24 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Deleted volume successfully.
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b16c792b-4738-4448-8fd5-62940f05a3ae tempest-ProjectReaderTests-722010951 None] Lock "cinder-727c6176-d80a-403b-b2f6-f9a79c7637bd-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87098) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Flow 'volume_create_manager' (b3893ac4-0ec2-4677-a15b-0cf0250e03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fef7ec1-bf31-40a7-8bad-e224ddc1dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fef7ec1-bf31-40a7-8bad-e224ddc1dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839108033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1829deac-26d5-42ea-bd3f-a925b2a672b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d8a868b9584223b52a756e4c3d13e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:25Z,use_quota=True,user_id='25fbf6d08bd547acbb7fd019dd2db89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c02633-37ae-4603-8265-172c0460653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c02633-37ae-4603-8265-172c0460653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10c44cb-a122-4103-9930-b4bae3ee2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10c44cb-a122-4103-9930-b4bae3ee2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1829deac-26d5-42ea-bd3f-a925b2a672b8', 'volume_name': 'volume-1829deac-26d5-42ea-bd3f-a925b2a672b8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04c92fd-0f4b-406f-9f04-c5f45e652b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04c92fd-0f4b-406f-9f04-c5f45e652b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9226ac-92c2-4b27-a567-f950e21e5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:24 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Volume 1829deac-26d5-42ea-bd3f-a925b2a672b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1829deac-26d5-42ea-bd3f-a925b2a672b8', 'volume_size': 1}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73b735d33fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839108033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1829deac-26d5-42ea-bd3f-a925b2a672b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d8a868b9584223b52a756e4c3d13e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:05:25Z,use_quota=True,user_id='25fbf6d08bd547acbb7fd019dd2db89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4fbc06-4f5c-402f-a68f-e44b4a807234),volume_type_id=0d4fbc06-4f5c-402f-a68f-e44b4a807234)}" {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.remotefs [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Creating volume 1829deac-26d5-42ea-bd3f-a925b2a672b8 {{(pid=87098) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Selected osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318 as target Quobyte volume. {{(pid=87098) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Nov 05 04:05:24 devstack cinder-volume[87098]: INFO cinder.volume.drivers.remotefs [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] casted to osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318
Nov 05 04:05:24 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 1073741824 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:24 devstack sudo[109615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 1073741824
Nov 05 04:05:24 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:25 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 1073741824" returned: 0 in 0.509s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:25 devstack sudo[109620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8
Nov 05 04:05:25 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:25 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8" returned: 0 in 0.258s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'} {{(pid=87098) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9226ac-92c2-4b27-a567-f950e21e5fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1829deac-26d5-42ea-bd3f-a925b2a672b8', 'volume_size': 1}' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1397960f-c791-4c87-a094-2ad83b76bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:05:25 devstack cinder-volume[87098]: INFO cinder.volume.flows.manager.create_volume [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Volume volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 (1829deac-26d5-42ea-bd3f-a925b2a672b8): created successfully
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1397960f-c791-4c87-a094-2ad83b76bb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87098) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:05:25 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Flow 'volume_create_manager' (b3893ac4-0ec2-4677-a15b-0cf0250e03a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87098) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:05:25 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-9cb82f61-ad1b-42e3-84fa-7c44cb1fe709 tempest-ProjectReaderTests-722010951 None] Created volume successfully.
Nov 05 04:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Acquiring lock "cinder-1829deac-26d5-42ea-bd3f-a925b2a672b8-delete_volume" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Lock "cinder-1829deac-26d5-42ea-bd3f-a925b2a672b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Acquiring lock "cinder-quobyte-1829deac-26d5-42ea-bd3f-a925b2a672b8" by "delete_volume" {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:05:26 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Lock "cinder-quobyte-1829deac-26d5-42ea-bd3f-a925b2a672b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87098) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1acdd7-96a6-42ab-bf2b-89f64c725c8a]: (4, 'qcow2') {{(pid=87997) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:27 devstack sudo[109623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8
Nov 05 04:05:27 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:27 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8" returned: 0 in 0.391s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8 {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:27 devstack sudo[109628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8
Nov 05 04:05:27 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:27 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd/volume-1829deac-26d5-42ea-bd3f-a925b2a672b8" returned: 0 in 0.243s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Lock "cinder-quobyte-1829deac-26d5-42ea-bd3f-a925b2a672b8" released by "delete_volume" :: held 0.676s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG cinder.quota [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Created reservations ['66dbe836-3433-4e6a-9c01-16863fe1fd99', 'bc008262-f5e2-4e44-a120-38c51e4795b7', '1a4fae3b-034c-4f79-8234-64c29f5f5c30', '38615e43-4b45-453e-911d-58501c21eee5'] {{(pid=87098) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318': None} {{(pid=87098) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8817f85d-285f-4f9f-87dc-b9e1d7cb6318'] {{(pid=87098) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87098) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:05:27 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:05:27 devstack sudo[109632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd
Nov 05 04:05:27 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:05:28 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root
Nov 05 04:05:28 devstack cinder-volume[87098]: DEBUG oslo_concurrency.processutils [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4ff22a4006d697594471bd98ac7d85cd" returned: 0 in 0.245s {{(pid=87098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:05:28 devstack cinder-volume[87098]: DEBUG cinder.manager [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Notifying Schedulers of capabilities ... {{(pid=87098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:05:28 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Deleted volume successfully.
Nov 05 04:05:28 devstack cinder-volume[87098]: DEBUG cinder.coordination [None req-b7ed29c6-3d83-4f57-b8fa-2c5e6ddacb99 tempest-ProjectReaderTests-722010951 None] Lock "cinder-1829deac-26d5-42ea-bd3f-a925b2a672b8-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87098) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:05:37 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:05:38 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=2,cinder:SELECT=16 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}